Jul 17 15:21:10 devstack cinder-volume[76146]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 15:21:10 devstack cinder-volume[76146]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 15:21:10 devstack cinder-volume[76146]: we strongly recommend against using it for new projects. Jul 17 15:21:10 devstack cinder-volume[76146]: If you are already using Eventlet, we recommend migrating to a different Jul 17 15:21:10 devstack cinder-volume[76146]: framework. For more detail see Jul 17 15:21:10 devstack cinder-volume[76146]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 15:21:10 devstack cinder-volume[76146]: import eventlet # noqa Jul 17 15:21:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 15:21:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 15:21:13 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 15:21:14 devstack cinder-volume[76146]: INFO dbcounter [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Registered counter for database cinder Jul 17 15:21:14 devstack cinder-volume[76146]: DEBUG oslo_db.sqlalchemy.engines [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:21:14 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writer thread running {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 15:21:14 devstack cinder-volume[76146]: INFO cinder.rpc [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 15:21:14 devstack cinder-volume[76146]: INFO cinder.rpc [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 15:21:14 devstack cinder-volume[76146]: DEBUG oslo_db.sqlalchemy.engines [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:21:14 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Determined volume DB was empty at startup. Jul 17 15:21:14 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76146) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 15:21:14 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 15:21:14 devstack cinder-volume[76146]: WARNING stevedore.named [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 15:21:14 devstack cinder-volume[76146]: WARNING castellan.key_manager [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 15:21:14 devstack cinder-volume[76146]: WARNING cinder.keymgr.conf_key_mgr [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 15:21:14 devstack cinder-volume[76146]: DEBUG cinder.volume.drivers.lvm [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76146) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 17 15:21:14 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] CMD "cinder-rtstool verify" returned: 0 in 0.456s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_db.sqlalchemy.engines [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:21:15 devstack cinder-volume[76146]: INFO cinder.rpc [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 17 15:21:15 devstack cinder-volume[76146]: INFO cinder.rpc [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 17 15:21:15 devstack cinder-volume[76146]: WARNING stevedore.named [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 15:21:15 devstack cinder-volume[76146]: WARNING castellan.key_manager [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 15:21:15 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_db.sqlalchemy.engines [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:21:15 devstack cinder-volume[76146]: INFO oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Starting 1 workers Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Started child 76287 {{(pid=76146) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Full set of CONF: {{(pid=76146) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] ******************************************************************************** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Configuration options gathered from: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] ================================================================================ {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] allow_availability_zone_fallback = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] allow_compression_on_image_upload = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] allowed_direct_url_schemes = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] api_rate_limit = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] auth_strategy = keystone {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] az_cache_duration = 3600 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_availability_zone = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_host = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_stats_polling_interval = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backup_api_class = cinder.backup.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backup_name_template = backup-%s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backup_use_same_host = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backup_use_temp_snapshot = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] chap_password = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] chap_username = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cinder_internal_tenant_project_id = 9b1985cb0c554a308bfc92045cd8223c {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cinder_internal_tenant_user_id = c57b668a8f8447e38044012affa5b01e {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cloned_volume_same_az = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76287]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cluster = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] compression_format = gzip {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] compute_api_class = cinder.compute.nova.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] config_dir = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] config_source = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] control_exchange = openstack {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] debug = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] default_availability_zone = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] default_group_type = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] default_volume_type = lvmdriver-1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] disk_geometry = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] driver_client_cert = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] driver_client_cert_key = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] driver_data_namespace = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] driver_ssl_cert_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] driver_ssl_cert_verify = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] driver_use_ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] enable_force_upload = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] enable_new_services = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] enable_unsupported_driver = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] enforce_multipath_for_image_xfer = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] filter_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_api_insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_api_ssl_compression = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_ca_certificates_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_catalog_info = image:glance:publicURL {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_num_retries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance_request_timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] goodness_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] graceful_shutdown_timeout = 5 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] group_api_class = cinder.group.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] host = devstack {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_compress_on_upload = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_conversion_address_space_limit = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_conversion_cpu_limit = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_conversion_disable = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_upload_use_cinder_backend = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_upload_use_internal_tenant = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_volume_cache_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_volume_cache_max_count = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] image_volume_cache_max_size_gb = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] init_host_max_objects_retrieval = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] instance_format = [instance: %(uuid)s] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] iscsi_target_flags = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] iscsi_write_cache = on {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] iser_helper = tgtadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] iser_ip_address = 192.168.122.24 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] iser_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] log_color = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] log_config_append = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] log_dir = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] log_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] log_options = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] log_rotate_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] log_rotate_interval_type = days {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] log_rotation_type = none {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] max_age = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] max_logfile_count = 30 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] max_logfile_size_mb = 200 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] max_over_subscription_ratio = 20.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] message_reap_interval = 86400 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] message_ttl = 2592000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] migration_create_volume_timeout_secs = 300 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] monkey_patch = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] monkey_patch_modules = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] my_ip = 192.168.122.24 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] no_snapshot_gb_quota = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] num_iser_scan_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] num_shell_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] num_volume_device_scan_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] nvmeof_conn_info_version = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] nvmet_ns_id = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] nvmet_port_id = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] osapi_max_limit = 1000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] osapi_volume_ext_list = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] osapi_volume_listen_port = 8776 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] osapi_volume_use_ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] osapi_volume_workers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] per_volume_size_limit = -1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] periodic_fuzzy_delay = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] periodic_interval = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] public_endpoint = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] publish_errors = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] quota_backup_gigabytes = 1000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] quota_backups = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] quota_gigabytes = 1000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] quota_groups = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] quota_snapshots = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] quota_volumes = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] rate_limit_burst = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] rate_limit_except_level = CRITICAL {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] rate_limit_interval = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] reinit_driver_count = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] replication_device = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] report_discard_supported = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] report_interval = 120 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] reservation_clean_interval = 86400 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] reservation_expire = 86400 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] reserved_image_namespaces = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] reserved_percentage = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] rpc_response_timeout = 120 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] run_external_periodic_tasks = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] scst_target_driver = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] scst_target_iqn_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_down_time = 720 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] shell_completion = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] snapshot_name_template = snapshot-%s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] snapshot_same_host = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] state_path = /opt/stack/data/cinder {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] storage_availability_zone = nova {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] storage_protocol = iSCSI {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] syslog_log_facility = LOG_USER {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] target_helper = lioadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] target_ip_address = 192.168.122.24 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] target_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76287]: INFO cinder.volume.manager [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] target_protocol = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] target_secondary_ip_addresses = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] trace_flags = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] transport_url = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] until_refresh = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] use_chap_auth = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] use_default_quota_class = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] use_journal = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] use_json = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] use_multipath_for_image_xfer = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] use_stderr = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] use_syslog = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] verify_glance_signatures = enabled {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_api_class = cinder.volume.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_backend_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_clear = zero {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_clear_ionice = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_clear_size = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_copy_bps_limit = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_dd_blocksize = 1M {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_name_template = volume-%s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_service_inithost_offload = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volume_usage_audit_period = month {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] zoning_mode = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_concurrency.disable_process_locking = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.auth_section = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.auth_type = password {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.auth_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.cache = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.include_service_catalog = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.interface = public {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_password = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcache_username = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.region_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.service_type = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.backend = dogpile.cache.null {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.backend_argument = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.backend_expiration_time = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.config_prefix = cache.oslo {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.debug_cache_backend = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.enable_retry_client = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.enable_socket_keepalive = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.expiration_time = 600 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.hashclient_retry_attempts = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.memcache_dead_retry = 300 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.memcache_pool_maxsize = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.memcache_sasl_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.password = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.proxies = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.redis_db = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.redis_server = localhost:6379 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.retry_attempts = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.retry_delay = 0.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.socket_keepalive_count = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.socket_keepalive_idle = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.socket_keepalive_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.socket_timeout = 1.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.tls_allowed_ciphers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.tls_cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.tls_certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.tls_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.tls_keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cache.username = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] coordination.backend_url = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.asyncio_connection = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.asyncio_slave_connection = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.backend = sqlalchemy {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.connection = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.connection_debug = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.connection_parameters = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.connection_recycle_time = 3600 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.connection_trace = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.db_inc_retry_interval = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.db_max_retries = 20 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.db_max_retry_interval = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.db_retry_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.max_overflow = 50 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.max_pool_size = 5 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.max_retries = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.mysql_wsrep_sync_wait = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.pool_timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.retry_interval = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.slave_connection = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.sqlite_synchronous = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.synchronous_reader = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] database.use_db_reconnect = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.connection_string = messaging:// {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.es_doc_type = notification {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.es_scroll_size = 10000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.es_scroll_time = 2m {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.filter_error_trace = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.hmac_keys = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.sentinel_service_name = mymaster {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.socket_timeout = 0.1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.trace_requests = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler.trace_sqlalchemy = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler_jaeger.process_tags = {} {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler_jaeger.service_name_prefix = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] profiler_otlp.service_name_prefix = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.enforce_new_defaults = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.policy_default_rule = default {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.policy_file = policy.yaml {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] privsep_osbrick.group = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] privsep_osbrick.helper_command = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] privsep_osbrick.user = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cinder_sys_admin.group = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cinder_sys_admin.helper_command = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] cinder_sys_admin.user = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.auth_section = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.auth_type = password {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.collect_timing = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.send_service_user_token = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] service_user.timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.auth_section = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.auth_type = password {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.collect_timing = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.region_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] glance.timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.backend_availability_zone = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.chap_password = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.chap_username = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.disk_geometry = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.driver_client_cert = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.driver_client_cert_key = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.driver_data_namespace = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.driver_use_ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.extra_capabilities = {} {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.filter_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.goodness_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.iscsi_target_flags = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.iscsi_write_cache = on {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.iser_helper = tgtadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.iser_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.lvm_share_target = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.lvm_type = auto {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.num_shell_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.replication_device = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.report_discard_supported = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.reserved_percentage = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.target_helper = tgtadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.target_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.target_protocol = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.trace_flags = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.unique_fqdn_network = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.use_chap_auth = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volume_backend_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volume_clear = zero {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volume_clear_ionice = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volume_clear_size = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_reports.file_event_handler = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_reports.log_dir = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.backend_host = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.chap_password = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.chap_username = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.disk_geometry = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.driver_client_cert = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.extra_capabilities = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.filter_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.goodness_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.iser_helper = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.iser_ip_address = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.iser_port = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.lvm_share_target = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.lvm_type = auto {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.num_shell_tries = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.replication_device = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.report_discard_supported = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.reserved_percentage = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.scst_target_driver = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.storage_protocol = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.target_helper = lioadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.target_ip_address = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.target_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.trace_flags = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.use_chap_auth = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volume_clear = zero {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volume_clear_size = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] lvmdriver-1.volumes_dir = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack sudo[76291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack sudo[76291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_notifications.driver = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_notifications.retry = -1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] key_manager.fixed_key = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.barbican_api_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.barbican_endpoint = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.barbican_endpoint_type = public {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.barbican_region_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.collect_timing = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.number_of_retries = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.retry_delay = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.send_service_user_token = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.verify_ssl = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican.verify_ssl_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican_service_user.auth_section = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican_service_user.auth_type = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican_service_user.cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican_service_user.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican_service_user.collect_timing = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican_service_user.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican_service_user.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican_service_user.split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] barbican_service_user.timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.approle_role_id = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.approle_secret_id = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.auth_method = approle {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.auth_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.kv_mountpoint = secret {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.kv_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.kv_version = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.namespace = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.root_token_id = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.ssl_ca_crt_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.timeout = 60.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.token_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.token_role = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.use_ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:21:15 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] ******************************************************************************** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 15:21:15 devstack sudo[76291]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:15 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:15 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:15 devstack sudo[76294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:21:15 devstack sudo[76294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:16 devstack sudo[76294]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:21:16 devstack cinder-volume[76287]: INFO cinder.brick.local_dev.lvm [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:16 devstack sudo[76339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 15:21:16 devstack sudo[76339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:16 devstack sudo[76339]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG cinder.brick.local_dev.lvm [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76287) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:16 devstack sudo[76457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:21:16 devstack sudo[76457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:16 devstack sudo[76457]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.506s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:16 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:16 devstack sudo[76632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:21:16 devstack sudo[76632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:17 devstack sudo[76632]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:17 devstack sudo[76727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 17 15:21:17 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:17 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.252s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:17 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 15:21:17 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:17 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:17 devstack sudo[76902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 15:21:17 devstack sudo[76902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:17 devstack sudo[76902]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:17 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:18 devstack sudo[76905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:21:18 devstack sudo[76905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:18 devstack sudo[76905]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.370s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:18 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:21:18 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:18 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:18 devstack sudo[76993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:21:18 devstack sudo[76993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:18 devstack sudo[76993]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.320s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:18 devstack cinder-volume[76287]: INFO cinder.volume.drivers.lvm [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:18 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:19 devstack sudo[77082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:21:19 devstack sudo[77082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:19 devstack sudo[77082]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:19 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:19 devstack cinder-volume[76287]: DEBUG cinder.volume.drivers.lvm [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Updating volume stats {{(pid=76287) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 15:21:19 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:19 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 15:21:19 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:19 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:19 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:19 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:19 devstack sudo[77094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:21:19 devstack sudo[77094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:19 devstack sudo[77094]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:19 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:19 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:19 devstack sudo[77097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:21:19 devstack sudo[77097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:20 devstack sudo[77097]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:20 devstack sudo[77100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:21:20 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:20 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:20 devstack cinder-volume[76287]: INFO cinder.volume.driver [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Driver hasn't implemented _init_vendor_properties() Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG cinder.volume.driver [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76287) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG oslo_db.sqlalchemy.engines [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76287) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG dbcounter [-] [76287] Writer thread running {{(pid=76287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG cinder.db.api [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Building query based on filter {{(pid=76287) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG cinder.image.image_utils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76287) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 15:21:20 devstack cinder-volume[76287]: INFO cinder.keymgr.migration [None req-6dc735bc-12e1-4356-9d49-3c8e23801272 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG cinder.volume.drivers.lvm [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Updating volume stats {{(pid=76287) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:20 devstack sudo[77105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 15:21:20 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:20 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:20 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:21:20 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:20 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:20 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:21 devstack sudo[77111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:21:21 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:21 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:21 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:21:21 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:21 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG cinder.manager [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Notifying Schedulers of capabilities ... {{(pid=76287) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:21:21 devstack cinder-volume[76287]: INFO cinder.volume.manager [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Driver initialization completed successfully. Jul 17 15:21:21 devstack cinder-volume[76287]: INFO cinder.manager [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Initiating service 2 cleanup Jul 17 15:21:21 devstack cinder-volume[76287]: INFO cinder.manager [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Service 2 cleanup completed. Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG cinder.service [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Creating RPC server for service cinder-volume {{(pid=76287) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG cinder.service [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76287) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 15:21:21 devstack cinder-volume[76287]: INFO cinder.volume.manager [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG cinder.volume.drivers.lvm [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Updating volume stats {{(pid=76287) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:21 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 15:21:21 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:21 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:21 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:21 devstack sudo[77123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:21:21 devstack sudo[77123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:22 devstack sudo[77123]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:22 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:22 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:22 devstack sudo[77127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:21:22 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:22 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:22 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:22 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:21:22 devstack sudo[77130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:21:22 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:21:22 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root Jul 17 15:21:22 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:21:22 devstack cinder-volume[76287]: INFO cinder.volume.manager [None req-fb875e56-0dab-4849-a70f-9a827eacddc1 None None] Driver post RPC initialization completed successfully. Jul 17 15:21:25 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:21:32 devstack cinder-volume[76287]: DEBUG dbcounter [-] [76287] Writing DB stats cinder:SELECT=4 {{(pid=76287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:21:32 devstack cinder-volume[76287]: DEBUG dbcounter [-] [76287] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:22:07 devstack cinder-volume[76287]: DEBUG oslo_service.periodic_task [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running periodic task VolumeManager._thread_info {{(pid=76287) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:22:07 devstack cinder-volume[76287]: DEBUG cinder.volume.manager [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] thread count: 6 {{(pid=76287) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:22:07 devstack cinder-volume[76287]: DEBUG cinder.volume.manager [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] thread info: [<_MainThread(MainThread, started 127507354468480)>, , , , , ] {{(pid=76287) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:23:07 devstack cinder-volume[76287]: DEBUG oslo_service.periodic_task [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76287) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:23:07 devstack cinder-volume[76287]: DEBUG cinder.volume.drivers.lvm [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Updating volume stats {{(pid=76287) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 15:23:07 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:23:07 devstack sudo[82358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 15:23:07 devstack sudo[82358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:23:08 devstack sudo[82358]: pam_unix(sudo:session): session closed for user root Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:23:08 devstack sudo[82361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:23:08 devstack sudo[82361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:23:08 devstack sudo[82361]: pam_unix(sudo:session): session closed for user root Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:23:08 devstack sudo[82364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:23:08 devstack sudo[82364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:23:08 devstack sudo[82364]: pam_unix(sudo:session): session closed for user root Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:23:08 devstack sudo[82367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:23:08 devstack sudo[82367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:23:08 devstack sudo[82367]: pam_unix(sudo:session): session closed for user root Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG cinder.manager [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Notifying Schedulers of capabilities ... {{(pid=76287) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG oslo_service.periodic_task [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running periodic task VolumeManager._thread_info {{(pid=76287) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG cinder.volume.manager [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] thread count: 6 {{(pid=76287) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:23:08 devstack cinder-volume[76287]: DEBUG cinder.volume.manager [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] thread info: [<_MainThread(MainThread, started 127507354468480)>, , , , , ] {{(pid=76287) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:23:32 devstack cinder-volume[76287]: DEBUG dbcounter [-] [76287] Writing DB stats cinder:SELECT=1 {{(pid=76287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:23:32 devstack cinder-volume[76287]: DEBUG dbcounter [-] [76287] Writing DB stats cinder:UPDATE=1 {{(pid=76287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:24:07 devstack cinder-volume[76287]: DEBUG oslo_service.periodic_task [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76287) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:24:07 devstack cinder-volume[76287]: DEBUG cinder.volume.drivers.lvm [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Updating volume stats {{(pid=76287) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 15:24:07 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:24:07 devstack sudo[83991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 15:24:07 devstack sudo[83991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:24:08 devstack sudo[83991]: pam_unix(sudo:session): session closed for user root Jul 17 15:24:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:24:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:24:08 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:24:08 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:24:08 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Jul 17 15:24:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:24:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:24:08 devstack sudo[84014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:24:08 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:24:08 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root Jul 17 15:24:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:24:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:24:08 devstack sudo[84022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:24:08 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:24:08 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root Jul 17 15:24:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:24:08 devstack cinder-volume[76287]: DEBUG cinder.manager [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Notifying Schedulers of capabilities ... {{(pid=76287) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:25:07 devstack cinder-volume[76287]: DEBUG oslo_service.periodic_task [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76287) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:25:07 devstack cinder-volume[76287]: DEBUG cinder.volume.drivers.lvm [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Updating volume stats {{(pid=76287) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 15:25:07 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:25:07 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 15:25:07 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:25:08 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:25:08 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:25:08 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:25:08 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:25:08 devstack sudo[85706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 15:25:08 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:25:08 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:25:08 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 15:25:08 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:25:08 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG oslo_concurrency.processutils [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG cinder.manager [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Notifying Schedulers of capabilities ... {{(pid=76287) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG oslo_service.periodic_task [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] Running periodic task VolumeManager._thread_info {{(pid=76287) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG cinder.volume.manager [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] thread count: 6 {{(pid=76287) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:25:08 devstack cinder-volume[76287]: DEBUG cinder.volume.manager [None req-c2ee3eba-d7c3-441d-9dce-2e65b68928b4 None None] thread info: [<_MainThread(MainThread, started 127507354468480)>, , , , , ] {{(pid=76287) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:25:32 devstack cinder-volume[76287]: DEBUG dbcounter [-] [76287] Writing DB stats cinder:SELECT=1 {{(pid=76287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:25:32 devstack cinder-volume[76287]: DEBUG dbcounter [-] [76287] Writing DB stats cinder:UPDATE=1 {{(pid=76287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:25:56 devstack cinder-volume[76146]: INFO oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Caught SIGTERM, stopping children Jul 17 15:25:56 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Acquiring lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 15:25:56 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Acquired lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 15:25:56 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Releasing lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 15:25:56 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Stop services. {{(pid=76146) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 15:25:56 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Killing children. {{(pid=76146) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 15:25:56 devstack cinder-volume[76146]: INFO oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Waiting on 1 children to exit Jul 17 15:25:56 devstack cinder-volume[76287]: DEBUG oslo_concurrency.lockutils [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Acquiring lock "singleton_lock" {{(pid=76287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 15:25:56 devstack cinder-volume[76287]: DEBUG oslo_concurrency.lockutils [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Acquired lock "singleton_lock" {{(pid=76287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 15:25:56 devstack cinder-volume[76287]: DEBUG oslo_concurrency.lockutils [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Releasing lock "singleton_lock" {{(pid=76287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 15:25:56 devstack cinder-volume[76287]: WARNING amqp [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 15:25:56 devstack cinder-volume[76287]: WARNING amqp [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 15:25:56 devstack cinder-volume[76146]: INFO oslo_service.backend._eventlet.service [None req-3a9ce6a1-4fcb-4c21-bdfa-b940c2cb2036 None None] Child 76287 exited with status 0 Jul 17 15:25:57 devstack cinder-volume[86815]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 15:25:57 devstack cinder-volume[86815]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 15:25:57 devstack cinder-volume[86815]: we strongly recommend against using it for new projects. Jul 17 15:25:57 devstack cinder-volume[86815]: If you are already using Eventlet, we recommend migrating to a different Jul 17 15:25:57 devstack cinder-volume[86815]: framework. For more detail see Jul 17 15:25:57 devstack cinder-volume[86815]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 15:25:57 devstack cinder-volume[86815]: import eventlet # noqa Jul 17 15:25:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 15:25:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 15:25:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 15:25:59 devstack cinder-volume[86815]: INFO dbcounter [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Registered counter for database cinder Jul 17 15:25:59 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writer thread running {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 15:26:00 devstack cinder-volume[86815]: INFO cinder.rpc [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 15:26:00 devstack cinder-volume[86815]: INFO cinder.rpc [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:26:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Determined volume DB was empty at startup. Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86815) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 15:26:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 15:26:00 devstack cinder-volume[86815]: WARNING stevedore.named [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 15:26:00 devstack cinder-volume[86815]: WARNING castellan.key_manager [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 15:26:00 devstack cinder-volume[86815]: WARNING cinder.keymgr.conf_key_mgr [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 15:26:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:26:00 devstack cinder-volume[86815]: INFO oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Starting 1 workers Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Started child 87043 {{(pid=86815) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Full set of CONF: {{(pid=86815) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] ******************************************************************************** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Configuration options gathered from: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] ================================================================================ {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] allow_availability_zone_fallback = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] allow_compression_on_image_upload = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] allowed_direct_url_schemes = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] api_rate_limit = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] auth_strategy = keystone {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_host = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_stats_polling_interval = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backup_api_class = cinder.backup.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backup_name_template = backup-%s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backup_use_same_host = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backup_use_temp_snapshot = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] chap_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] chap_username = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cinder_internal_tenant_project_id = 9b1985cb0c554a308bfc92045cd8223c {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cinder_internal_tenant_user_id = c57b668a8f8447e38044012affa5b01e {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cluster = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] compression_format = gzip {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] compute_api_class = cinder.compute.nova.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[87043]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] config_dir = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] config_source = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] control_exchange = openstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] debug = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] default_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] default_group_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] default_volume_type = QuobyteHD {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] disk_geometry = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] driver_client_cert = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] driver_client_cert_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] driver_data_namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] driver_ssl_cert_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] driver_ssl_cert_verify = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] driver_use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] enable_new_services = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] enable_unsupported_driver = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] enabled_backends = ['QuobyteHD'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] enforce_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] filter_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_api_insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_api_ssl_compression = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_ca_certificates_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_catalog_info = image:glance:publicURL {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_num_retries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance_request_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] goodness_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] graceful_shutdown_timeout = 5 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] group_api_class = cinder.group.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] host = devstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_compress_on_upload = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_conversion_address_space_limit = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_conversion_cpu_limit = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_conversion_disable = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_upload_use_cinder_backend = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_upload_use_internal_tenant = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_volume_cache_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_volume_cache_max_count = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] image_volume_cache_max_size_gb = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] init_host_max_objects_retrieval = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] instance_format = [instance: %(uuid)s] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] iscsi_target_flags = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] iscsi_write_cache = on {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] iser_helper = tgtadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] iser_ip_address = 192.168.122.24 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] iser_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] log_color = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] log_config_append = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] log_dir = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] log_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] log_options = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] log_rotate_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] log_rotate_interval_type = days {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] log_rotation_type = none {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] max_age = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] max_logfile_count = 30 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] max_logfile_size_mb = 200 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] max_over_subscription_ratio = 20.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] message_reap_interval = 86400 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] message_ttl = 2592000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] migration_create_volume_timeout_secs = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] monkey_patch = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] monkey_patch_modules = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] my_ip = 192.168.122.24 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] no_snapshot_gb_quota = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] num_iser_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] num_shell_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] num_volume_device_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] nvmeof_conn_info_version = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] nvmet_ns_id = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] nvmet_port_id = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] osapi_max_limit = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] osapi_volume_ext_list = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] osapi_volume_listen_port = 8776 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] osapi_volume_use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] osapi_volume_workers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] per_volume_size_limit = -1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] periodic_fuzzy_delay = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] periodic_interval = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] public_endpoint = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] publish_errors = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] quota_backup_gigabytes = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] quota_backups = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] quota_gigabytes = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] quota_groups = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] quota_snapshots = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] quota_volumes = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] rate_limit_burst = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] rate_limit_except_level = CRITICAL {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] rate_limit_interval = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] reinit_driver_count = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] replication_device = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] report_discard_supported = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] report_interval = 120 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] reservation_clean_interval = 86400 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] reservation_expire = 86400 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] reserved_image_namespaces = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] reserved_percentage = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] rpc_response_timeout = 120 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] run_external_periodic_tasks = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] scst_target_driver = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] scst_target_iqn_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_down_time = 720 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] shell_completion = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] snapshot_name_template = snapshot-%s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] state_path = /opt/stack/data/cinder {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] storage_availability_zone = nova {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] storage_protocol = iSCSI {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] syslog_log_facility = LOG_USER {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] target_helper = lioadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] target_ip_address = 192.168.122.24 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] target_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] target_protocol = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] target_secondary_ip_addresses = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] trace_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] transport_url = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] until_refresh = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] use_chap_auth = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] use_default_quota_class = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] use_journal = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] use_json = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] use_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] use_stderr = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] use_syslog = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] verify_glance_signatures = enabled {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_api_class = cinder.volume.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_backend_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_clear = zero {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_clear_ionice = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_clear_size = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_copy_bps_limit = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_dd_blocksize = 1M {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_name_template = volume-%s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_service_inithost_offload = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volume_usage_audit_period = month {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] zoning_mode = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_concurrency.disable_process_locking = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.auth_type = password {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.auth_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.cache = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.include_service_catalog = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.interface = public {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_password = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcache_username = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.region_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.service_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.backend = dogpile.cache.null {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.backend_argument = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.backend_expiration_time = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.config_prefix = cache.oslo {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.debug_cache_backend = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.enable_retry_client = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.enable_socket_keepalive = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.expiration_time = 600 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.hashclient_retry_attempts = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.memcache_dead_retry = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.memcache_pool_maxsize = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.memcache_sasl_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.proxies = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.redis_db = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.redis_server = localhost:6379 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.retry_attempts = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.retry_delay = 0.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.socket_keepalive_count = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.socket_keepalive_idle = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[87043]: INFO cinder.volume.manager [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Starting volume driver QuobyteDriver (1.2) Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.socket_keepalive_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.socket_timeout = 1.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[87043]: DEBUG cinder.volume.drivers.remotefs [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87043) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.tls_allowed_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.tls_cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.tls_certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.tls_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.tls_keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cache.username = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:00 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] coordination.backend_url = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.asyncio_connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.asyncio_slave_connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.backend = sqlalchemy {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.connection_debug = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.connection_parameters = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.connection_recycle_time = 3600 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.connection_trace = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.db_inc_retry_interval = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.db_max_retries = 20 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.db_max_retry_interval = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.db_retry_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.max_overflow = 50 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.max_pool_size = 5 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.max_retries = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.mysql_wsrep_sync_wait = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.pool_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.retry_interval = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.slave_connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.sqlite_synchronous = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.synchronous_reader = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] database.use_db_reconnect = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.connection_string = messaging:// {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.es_doc_type = notification {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.es_scroll_size = 10000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.es_scroll_time = 2m {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.filter_error_trace = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.hmac_keys = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.sentinel_service_name = mymaster {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.socket_timeout = 0.1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.trace_requests = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler.trace_sqlalchemy = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler_jaeger.process_tags = {} {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler_jaeger.service_name_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] profiler_otlp.service_name_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.enforce_new_defaults = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.policy_default_rule = default {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.policy_file = policy.yaml {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] privsep_osbrick.group = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] privsep_osbrick.helper_command = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] privsep_osbrick.user = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cinder_sys_admin.group = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cinder_sys_admin.helper_command = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] cinder_sys_admin.user = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.auth_type = password {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.send_service_user_token = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] service_user.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.auth_type = password {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.region_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] glance.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.backend_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.chap_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.chap_username = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.disk_geometry = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.driver_client_cert = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.driver_client_cert_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.driver_data_namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.driver_use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.extra_capabilities = {} {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.filter_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.goodness_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.iscsi_target_flags = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.iscsi_write_cache = on {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.iser_helper = tgtadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.iser_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_host = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_login = admin {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_mount_options = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_private_key = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_share_path = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.num_shell_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.quobyte_volume_url = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.replication_device = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.report_discard_supported = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.reserved_percentage = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.target_helper = tgtadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.target_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.target_protocol = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.trace_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.unique_fqdn_network = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.use_chap_auth = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.volume_backend_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.volume_clear = zero {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.volume_clear_ionice = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.volume_clear_size = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_reports.file_event_handler = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_reports.log_dir = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.backend_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.backend_host = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.chap_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.chap_username = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.chiscsi_conf = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.disk_geometry = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.driver_client_cert = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.driver_data_namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.driver_use_ssl = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.extra_capabilities = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.filter_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.goodness_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.iser_helper = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.iser_ip_address = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.iser_port = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.iser_target_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_host = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_login = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_mount_options = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_private_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_share_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_ssh_port = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.num_shell_tries = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.nvmet_port_id = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.replication_device = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.report_discard_supported = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.reserved_percentage = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87043) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 15:26:01 devstack cinder-volume[87043]: WARNING cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 15:26:01 devstack cinder-volume[87043]: WARNING cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Running cmd (subprocess): mount.quobyte {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.scst_target_driver = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.storage_protocol = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.target_helper = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.target_ip_address = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.target_port = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.target_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.target_protocol = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.trace_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.use_chap_auth = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.volume_clear = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.volume_clear_size = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] QuobyteHD.volumes_dir = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_notifications.driver = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_notifications.retry = -1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] key_manager.fixed_key = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.barbican_api_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.barbican_endpoint = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.barbican_endpoint_type = public {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.barbican_region_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.number_of_retries = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.retry_delay = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.send_service_user_token = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.verify_ssl = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican.verify_ssl_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican_service_user.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican_service_user.auth_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican_service_user.cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican_service_user.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican_service_user.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican_service_user.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican_service_user.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican_service_user.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] barbican_service_user.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.approle_role_id = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.approle_secret_id = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.auth_method = approle {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.auth_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.kv_mountpoint = secret {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.kv_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.kv_version = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.root_token_id = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.ssl_ca_crt_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.timeout = 60.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.token_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.token_role = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:01 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] ******************************************************************************** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 15:26:01 devstack quobyte-client[87047]: Reading configuration file: /etc/quobyte/client.cfg Jul 17 15:26:01 devstack quobyte-client[87047]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] CMD "mount.quobyte" returned: 1 in 0.101s {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87043) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87043) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87043) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:26:01 devstack cinder-volume[87043]: INFO cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 ... Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a -c /etc/quobyte/client-cinder.cfg {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:26:01 devstack sudo[87048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a -c /etc/quobyte/client-cinder.cfg Jul 17 15:26:01 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:26:01 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.403s {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:26:01 devstack cinder-volume[87043]: INFO cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 succeeded Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87043) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.417s {{(pid=87043) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:26:01 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:26:01 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:26:01 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.269s {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:26:01 devstack cinder-volume[87043]: INFO cinder.volume.driver [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Driver hasn't implemented _init_vendor_properties() Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG cinder.volume.driver [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7388076782227, 'free_capacity_gb': 1775.7388076782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87043) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_db.sqlalchemy.engines [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87043) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG dbcounter [-] [87043] Writer thread running {{(pid=87043) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG cinder.db.api [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Building query based on filter {{(pid=87043) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG cinder.image.image_utils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87043) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 15:26:01 devstack cinder-volume[87043]: INFO cinder.keymgr.migration [None req-2379edc2-204d-4fc4-95f4-d0b925fbb83a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87043) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87043) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87043) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87043) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87043) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:26:01 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:26:02 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:26:02 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:26:02 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.248s {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG cinder.manager [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Notifying Schedulers of capabilities ... {{(pid=87043) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:26:02 devstack cinder-volume[87043]: INFO cinder.volume.manager [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Driver initialization completed successfully. Jul 17 15:26:02 devstack cinder-volume[87043]: INFO cinder.manager [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Initiating service 3 cleanup Jul 17 15:26:02 devstack cinder-volume[87043]: INFO cinder.manager [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Service 3 cleanup completed. Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG cinder.service [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Creating RPC server for service cinder-volume {{(pid=87043) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG cinder.service [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87043) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 15:26:02 devstack cinder-volume[87043]: INFO cinder.volume.manager [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87043) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87043) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87043) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87043) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87043) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:26:02 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:26:02 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:26:02 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Jul 17 15:26:02 devstack cinder-volume[87043]: DEBUG oslo_concurrency.processutils [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.250s {{(pid=87043) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:26:02 devstack cinder-volume[87043]: INFO cinder.volume.manager [None req-e1eb3d50-6fc1-49b0-8d37-ec83484c08e1 None None] Driver post RPC initialization completed successfully. Jul 17 15:26:03 devstack cinder-volume[87043]: DEBUG oslo_service.periodic_task [None req-829bdd67-432d-458a-9c73-07c88315a4f3 None None] Running periodic task VolumeManager._thread_info {{(pid=87043) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:26:03 devstack cinder-volume[87043]: DEBUG cinder.volume.manager [None req-829bdd67-432d-458a-9c73-07c88315a4f3 None None] thread count: 6 {{(pid=87043) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:26:03 devstack cinder-volume[87043]: DEBUG cinder.volume.manager [None req-829bdd67-432d-458a-9c73-07c88315a4f3 None None] thread info: [<_MainThread(MainThread, started 124254626422912)>, , , , , ] {{(pid=87043) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:26:06 devstack cinder-volume[86815]: INFO oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Caught SIGTERM, stopping children Jul 17 15:26:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Acquiring lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 15:26:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Acquired lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 15:26:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Releasing lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 15:26:06 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Stop services. {{(pid=86815) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 15:26:06 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Killing children. {{(pid=86815) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 15:26:06 devstack cinder-volume[86815]: INFO oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Waiting on 1 children to exit Jul 17 15:26:10 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Acquiring lock "singleton_lock" {{(pid=87043) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 15:26:10 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Acquired lock "singleton_lock" {{(pid=87043) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 15:26:10 devstack cinder-volume[87043]: DEBUG oslo_concurrency.lockutils [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Releasing lock "singleton_lock" {{(pid=87043) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 15:26:10 devstack cinder-volume[87043]: WARNING amqp [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 15:26:10 devstack cinder-volume[87043]: WARNING amqp [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 15:26:10 devstack cinder-volume[86815]: INFO oslo_service.backend._eventlet.service [None req-d4179655-bd43-4491-b73d-022ed9506281 None None] Child 87043 exited with status 0 Jul 17 15:26:11 devstack cinder-volume[87468]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 15:26:11 devstack cinder-volume[87468]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 15:26:11 devstack cinder-volume[87468]: we strongly recommend against using it for new projects. Jul 17 15:26:11 devstack cinder-volume[87468]: If you are already using Eventlet, we recommend migrating to a different Jul 17 15:26:11 devstack cinder-volume[87468]: framework. For more detail see Jul 17 15:26:11 devstack cinder-volume[87468]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 15:26:11 devstack cinder-volume[87468]: import eventlet # noqa Jul 17 15:26:14 devstack cinder-volume[87468]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87468) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 15:26:14 devstack cinder-volume[87468]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87468) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 15:26:14 devstack cinder-volume[87468]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87468) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 15:26:14 devstack cinder-volume[87468]: INFO dbcounter [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Registered counter for database cinder Jul 17 15:26:14 devstack cinder-volume[87468]: DEBUG oslo_db.sqlalchemy.engines [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG dbcounter [-] [87468] Writer thread running {{(pid=87468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 15:26:15 devstack cinder-volume[87468]: INFO cinder.rpc [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 15:26:15 devstack cinder-volume[87468]: INFO cinder.rpc [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_db.sqlalchemy.engines [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:26:15 devstack cinder-volume[87468]: INFO cinder.volume.manager [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Determined volume DB was empty at startup. Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG cinder.volume.manager [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87468) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 15:26:15 devstack cinder-volume[87468]: WARNING stevedore.named [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 15:26:15 devstack cinder-volume[87468]: WARNING castellan.key_manager [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 15:26:15 devstack cinder-volume[87468]: WARNING cinder.keymgr.conf_key_mgr [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 15:26:15 devstack cinder-volume[87468]: INFO cinder.volume.manager [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_db.sqlalchemy.engines [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:26:15 devstack cinder-volume[87468]: INFO oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Starting 1 workers Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Started child 87769 {{(pid=87468) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Full set of CONF: {{(pid=87468) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] ******************************************************************************** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] Configuration options gathered from: {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] ================================================================================ {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] allow_availability_zone_fallback = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] allow_compression_on_image_upload = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] allowed_direct_url_schemes = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] api_rate_limit = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] auth_strategy = keystone {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_availability_zone = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_host = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_stats_polling_interval = 60 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backup_api_class = cinder.backup.api.API {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87769]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backup_name_template = backup-%s {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backup_use_same_host = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backup_use_temp_snapshot = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] chap_password = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] chap_username = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cinder_internal_tenant_project_id = 9b1985cb0c554a308bfc92045cd8223c {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cinder_internal_tenant_user_id = c57b668a8f8447e38044012affa5b01e {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cluster = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] compression_format = gzip {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] compute_api_class = cinder.compute.nova.API {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] config_dir = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] config_source = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] control_exchange = openstack {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] debug = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] default_availability_zone = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] default_group_type = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] default_volume_type = QuobyteHD {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] disk_geometry = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] driver_client_cert = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] driver_client_cert_key = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] driver_data_namespace = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] driver_ssl_cert_path = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] driver_ssl_cert_verify = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] driver_use_ssl = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] enable_new_services = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] enable_unsupported_driver = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] enabled_backends = ['QuobyteHD'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] enforce_multipath_for_image_xfer = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] filter_function = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_api_insecure = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_api_ssl_compression = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_ca_certificates_file = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_catalog_info = image:glance:publicURL {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_certfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_keyfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_num_retries = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance_request_timeout = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] goodness_function = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] graceful_shutdown_timeout = 5 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] group_api_class = cinder.group.api.API {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] host = devstack {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_compress_on_upload = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_conversion_address_space_limit = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_conversion_cpu_limit = 60 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_conversion_disable = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_upload_use_cinder_backend = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_upload_use_internal_tenant = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_volume_cache_enabled = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_volume_cache_max_count = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] image_volume_cache_max_size_gb = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] init_host_max_objects_retrieval = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] instance_format = [instance: %(uuid)s] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] iscsi_target_flags = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] iscsi_write_cache = on {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] iser_helper = tgtadm {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] iser_ip_address = 192.168.122.24 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] iser_port = 3260 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] log_color = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] log_config_append = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] log_dir = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] log_file = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] log_options = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] log_rotate_interval = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] log_rotate_interval_type = days {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] log_rotation_type = none {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] max_age = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] max_logfile_count = 30 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] max_logfile_size_mb = 200 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] max_over_subscription_ratio = 20.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] message_reap_interval = 86400 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] message_ttl = 2592000 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] migration_create_volume_timeout_secs = 300 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] monkey_patch = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] monkey_patch_modules = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] my_ip = 192.168.122.24 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] no_snapshot_gb_quota = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] num_iser_scan_tries = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] num_shell_tries = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] num_volume_device_scan_tries = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] nvmeof_conn_info_version = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] nvmet_ns_id = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] nvmet_port_id = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] osapi_max_limit = 1000 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] osapi_volume_ext_list = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] osapi_volume_listen_port = 8776 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] osapi_volume_use_ssl = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] osapi_volume_workers = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] per_volume_size_limit = -1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] periodic_fuzzy_delay = 60 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] periodic_interval = 60 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] public_endpoint = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] publish_errors = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] quota_backup_gigabytes = 1000 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] quota_backups = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] quota_gigabytes = 1000 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] quota_groups = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] quota_snapshots = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] quota_volumes = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] rate_limit_burst = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] rate_limit_except_level = CRITICAL {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] rate_limit_interval = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] reinit_driver_count = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] replication_device = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] report_discard_supported = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] report_interval = 120 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] reservation_clean_interval = 86400 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] reservation_expire = 86400 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] reserved_image_namespaces = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] reserved_percentage = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] rpc_response_timeout = 120 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] run_external_periodic_tasks = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] scst_target_driver = iscsi {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] scst_target_iqn_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_down_time = 720 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] shell_completion = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] snapshot_name_template = snapshot-%s {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] split_loggers = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] state_path = /opt/stack/data/cinder {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] storage_availability_zone = nova {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] storage_protocol = iSCSI {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] syslog_log_facility = LOG_USER {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] target_helper = lioadm {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] target_ip_address = 192.168.122.24 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] target_port = 3260 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] target_protocol = iscsi {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] target_secondary_ip_addresses = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] trace_flags = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] transport_url = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] until_refresh = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] use_chap_auth = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] use_default_quota_class = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] use_journal = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] use_json = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] use_multipath_for_image_xfer = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] use_stderr = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] use_syslog = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] verify_glance_signatures = enabled {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_api_class = cinder.volume.api.API {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_backend_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_clear = zero {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_clear_ionice = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_clear_size = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Starting volume driver QuobyteDriver (1.2) Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_copy_bps_limit = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_dd_blocksize = 1M {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_name_template = volume-%s {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_service_inithost_offload = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volume_usage_audit_period = month {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87769) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] zoning_mode = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_concurrency.disable_process_locking = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.auth_section = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.auth_type = password {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.auth_version = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.cache = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.certfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.include_service_catalog = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.insecure = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.interface = public {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.keyfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_password = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcache_username = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.region_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.service_type = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.backend = dogpile.cache.null {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.backend_argument = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.backend_expiration_time = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.config_prefix = cache.oslo {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.debug_cache_backend = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.enable_retry_client = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.enable_socket_keepalive = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.enabled = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.expiration_time = 600 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.hashclient_retry_attempts = 2 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.memcache_dead_retry = 300 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.memcache_pool_maxsize = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.memcache_sasl_enabled = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.password = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.proxies = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.redis_db = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.redis_server = localhost:6379 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.retry_attempts = 2 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.retry_delay = 0.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.socket_keepalive_count = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.socket_keepalive_idle = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.socket_keepalive_interval = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.socket_timeout = 1.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.tls_allowed_ciphers = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.tls_cafile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.tls_certfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.tls_enabled = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.tls_keyfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cache.username = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] coordination.backend_url = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.asyncio_connection = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.asyncio_slave_connection = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.backend = sqlalchemy {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.connection = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.connection_debug = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.connection_parameters = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.connection_recycle_time = 3600 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.connection_trace = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.db_inc_retry_interval = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.db_max_retries = 20 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.db_max_retry_interval = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.db_retry_interval = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.max_overflow = 50 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.max_pool_size = 5 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.max_retries = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.mysql_wsrep_sync_wait = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.pool_timeout = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.retry_interval = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.slave_connection = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.sqlite_synchronous = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.synchronous_reader = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] database.use_db_reconnect = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.connection_string = messaging:// {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.enabled = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.es_doc_type = notification {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.es_scroll_size = 10000 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.es_scroll_time = 2m {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.filter_error_trace = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.hmac_keys = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.sentinel_service_name = mymaster {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.socket_timeout = 0.1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.trace_requests = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler.trace_sqlalchemy = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler_jaeger.process_tags = {} {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler_jaeger.service_name_prefix = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] profiler_otlp.service_name_prefix = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.enforce_new_defaults = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.policy_default_rule = default {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.policy_file = policy.yaml {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] privsep_osbrick.group = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] privsep_osbrick.helper_command = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] privsep_osbrick.user = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cinder_sys_admin.group = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cinder_sys_admin.helper_command = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] cinder_sys_admin.user = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.auth_section = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.auth_type = password {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.cafile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.certfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.collect_timing = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.insecure = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.keyfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.send_service_user_token = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.split_loggers = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] service_user.timeout = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.auth_section = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.auth_type = password {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.certfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.collect_timing = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.insecure = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.keyfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.region_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.split_loggers = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] glance.timeout = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.backend_availability_zone = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.chap_password = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.chap_username = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.disk_geometry = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.driver_client_cert = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.driver_client_cert_key = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.driver_data_namespace = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.driver_use_ssl = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.extra_capabilities = {} {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.filter_function = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.goodness_function = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.iscsi_target_flags = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.iscsi_write_cache = on {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.iser_helper = tgtadm {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.iser_port = 3260 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_host = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_login = admin {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_mount_options = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_password = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_private_key = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_share_path = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.num_shell_tries = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.quobyte_volume_url = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.replication_device = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.report_discard_supported = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.reserved_percentage = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.target_helper = tgtadm {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.target_port = 3260 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.target_protocol = iscsi {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.trace_flags = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.unique_fqdn_network = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.use_chap_auth = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.volume_backend_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.volume_clear = zero {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.volume_clear_ionice = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.volume_clear_size = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_reports.file_event_handler = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_reports.log_dir = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.backend_availability_zone = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.backend_host = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.chap_password = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.chap_username = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.chiscsi_conf = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.disk_geometry = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.driver_client_cert = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.driver_data_namespace = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.driver_use_ssl = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.extra_capabilities = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.filter_function = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.goodness_function = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.iser_helper = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.iser_ip_address = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.iser_port = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.iser_target_prefix = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_host = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_login = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_mount_options = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_password = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_private_key = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_share_path = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_ssh_port = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.num_shell_tries = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.nvmet_port_id = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.replication_device = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.report_discard_supported = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.reserved_percentage = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.scst_target_driver = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.storage_protocol = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.target_helper = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87769) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 15:26:15 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.quobyte [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 15:26:15 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.quobyte [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.target_ip_address = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.target_port = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.target_prefix = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.target_protocol = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.trace_flags = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.use_chap_auth = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.volume_clear = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.volume_clear_size = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] QuobyteHD.volumes_dir = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Running cmd (subprocess): mount.quobyte {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.ssl = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_notifications.driver = [] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_notifications.retry = -1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] key_manager.fixed_key = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.barbican_api_version = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.barbican_endpoint = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.barbican_endpoint_type = public {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.barbican_region_name = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.cafile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.certfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.collect_timing = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.insecure = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.keyfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.number_of_retries = 60 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.retry_delay = 1 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.send_service_user_token = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.split_loggers = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.timeout = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.verify_ssl = True {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican.verify_ssl_path = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican_service_user.auth_section = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican_service_user.auth_type = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican_service_user.cafile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican_service_user.certfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican_service_user.collect_timing = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican_service_user.insecure = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican_service_user.keyfile = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican_service_user.split_loggers = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] barbican_service_user.timeout = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.approle_role_id = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.approle_secret_id = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.auth_method = approle {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.auth_path = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.kv_mountpoint = secret {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.kv_path = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.kv_version = 2 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.namespace = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.root_token_id = **** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.ssl_ca_crt_file = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.timeout = 60.0 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.token_file = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.token_role = None {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.use_ssl = False {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 15:26:15 devstack cinder-volume[87468]: DEBUG oslo_service.backend._eventlet.service [None req-6c2865ee-0db1-43c4-b75a-f49382694eb4 None None] ******************************************************************************** {{(pid=87468) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 15:26:15 devstack quobyte-client[87771]: Reading configuration file: /etc/quobyte/client.cfg Jul 17 15:26:15 devstack quobyte-client[87771]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] CMD "mount.quobyte" returned: 1 in 0.089s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:26:15 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:26:15 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:26:15 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.257s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:26:15 devstack cinder-volume[87769]: INFO cinder.volume.driver [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Driver hasn't implemented _init_vendor_properties() Jul 17 15:26:15 devstack cinder-volume[87769]: DEBUG cinder.volume.driver [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7388076782227, 'free_capacity_gb': 1775.7388076782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87769) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writer thread running {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG cinder.db.api [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Building query based on filter {{(pid=87769) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87769) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:26:16 devstack cinder-volume[87769]: INFO cinder.keymgr.migration [None req-59563076-2d91-4506-9396-d783fc6cee8b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 15:26:16 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:26:16 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:26:16 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.229s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:26:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Driver initialization completed successfully. Jul 17 15:26:16 devstack cinder-volume[87769]: INFO cinder.manager [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Initiating service 3 cleanup Jul 17 15:26:16 devstack cinder-volume[87769]: INFO cinder.manager [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Service 3 cleanup completed. Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG cinder.service [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Creating RPC server for service cinder-volume {{(pid=87769) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG cinder.service [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87769) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 15:26:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:26:16 devstack sudo[87785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:26:16 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:26:16 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root Jul 17 15:26:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.231s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:26:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-dcb9e409-6ed3-4946-9d81-bee980d80c5b None None] Driver post RPC initialization completed successfully. Jul 17 15:26:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:26:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 6 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:26:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:26:25 devstack cinder-volume[87468]: DEBUG dbcounter [-] [87468] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:26:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:26:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Flow 'volume_create_manager' (ae2f6ed1-7616-4404-8c65-90bc1ff6c867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26205cfb-89fb-4624-9338-78a087f199f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26205cfb-89fb-4624-9338-78a087f199f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-208416236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8959ad18-f311-417a-961e-0cc134a5616b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c360729d519c47f9a27c4122955729a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:27:20Z,use_quota=True,user_id='e9a4a607dbca4f87a4c5142b99c92097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71d65d7-5789-4906-913c-90d717af4c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71d65d7-5789-4906-913c-90d717af4c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3210cdf2-dbe0-4495-90bc-23e4c955805c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3210cdf2-dbe0-4495-90bc-23e4c955805c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8959ad18-f311-417a-961e-0cc134a5616b', 'volume_name': 'volume-8959ad18-f311-417a-961e-0cc134a5616b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a26985-2e0e-42f9-8df5-8241c64e846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a26985-2e0e-42f9-8df5-8241c64e846c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e02395-b9b8-4cdb-b7a6-6c6d194154f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Volume 8959ad18-f311-417a-961e-0cc134a5616b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8959ad18-f311-417a-961e-0cc134a5616b', 'volume_size': 1} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-208416236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8959ad18-f311-417a-961e-0cc134a5616b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c360729d519c47f9a27c4122955729a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:27:20Z,use_quota=True,user_id='e9a4a607dbca4f87a4c5142b99c92097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Creating volume 8959ad18-f311-417a-961e-0cc134a5616b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:27:20 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:27:20 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b 1073741824 Jul 17 15:27:20 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:27:20 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Jul 17 15:27:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b 1073741824" returned: 0 in 0.670s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:27:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:27:21 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b Jul 17 15:27:21 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:27:21 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Jul 17 15:27:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b" returned: 0 in 0.331s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:27:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:27:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:27:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e02395-b9b8-4cdb-b7a6-6c6d194154f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8959ad18-f311-417a-961e-0cc134a5616b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33879213-d332-4f74-a944-8b76ef600103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Volume volume-8959ad18-f311-417a-961e-0cc134a5616b (8959ad18-f311-417a-961e-0cc134a5616b): created successfully Jul 17 15:27:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33879213-d332-4f74-a944-8b76ef600103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Flow 'volume_create_manager' (ae2f6ed1-7616-4404-8c65-90bc1ff6c867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:27:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-265b228b-6cea-4e97-9c93-fcf58a75ca20 tempest-TaggedAttachmentsTest-1858231890 None] Created volume successfully. Jul 17 15:27:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:27:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:27:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:27:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:27:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:27:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:27:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:27:22 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:27:22 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:27:23 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Jul 17 15:27:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.466s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:27:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:27:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:27:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 6 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:27:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:27:31 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:27:31 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:27:42 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:27:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Flow 'volume_create_manager' (961a6171-c866-45fc-a3c3-6e52ea8e286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:27:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451734f2-2f68-4e24-b889-cd30358b3635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451734f2-2f68-4e24-b889-cd30358b3635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1015337778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df254ca-a3b7-488a-af50-1daee7dcbaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599ea0fd5be2429eb60c39d05764db0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:27:43Z,use_quota=True,user_id='f8ca42f8700c4c24aa953d2cde3de5f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0301e466-c002-4feb-8342-4cd395561a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0301e466-c002-4feb-8342-4cd395561a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d13710-afd6-4dff-8a04-a4d36f08b027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d13710-afd6-4dff-8a04-a4d36f08b027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df254ca-a3b7-488a-af50-1daee7dcbaad', 'volume_name': 'volume-8df254ca-a3b7-488a-af50-1daee7dcbaad', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (593d102b-596b-40ba-8bdc-dee9f3aa3f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (593d102b-596b-40ba-8bdc-dee9f3aa3f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0eaf90-0c8c-47f6-8c09-0dc1b76cae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:43 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Volume 8df254ca-a3b7-488a-af50-1daee7dcbaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df254ca-a3b7-488a-af50-1daee7dcbaad', 'volume_size': 1} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1015337778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df254ca-a3b7-488a-af50-1daee7dcbaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599ea0fd5be2429eb60c39d05764db0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:27:43Z,use_quota=True,user_id='f8ca42f8700c4c24aa953d2cde3de5f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Creating volume 8df254ca-a3b7-488a-af50-1daee7dcbaad {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:27:43 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:27:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:27:43 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad 1073741824 Jul 17 15:27:43 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:27:44 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Jul 17 15:27:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad 1073741824" returned: 0 in 1.422s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:27:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:27:44 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad Jul 17 15:27:44 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:27:45 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Jul 17 15:27:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad" returned: 0 in 0.502s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:27:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:27:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:27:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0eaf90-0c8c-47f6-8c09-0dc1b76cae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df254ca-a3b7-488a-af50-1daee7dcbaad', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4234a73b-25e6-4657-9f42-e65a1332d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Volume volume-8df254ca-a3b7-488a-af50-1daee7dcbaad (8df254ca-a3b7-488a-af50-1daee7dcbaad): created successfully Jul 17 15:27:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4234a73b-25e6-4657-9f42-e65a1332d21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Flow 'volume_create_manager' (961a6171-c866-45fc-a3c3-6e52ea8e286f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:27:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d7be724e-4f6a-4463-8095-b207346678c9 tempest-VolumesAdminNegativeTest-659650382 None] Created volume successfully. Jul 17 15:27:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Acquiring lock "cinder-8df254ca-a3b7-488a-af50-1daee7dcbaad-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:27:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Lock "cinder-8df254ca-a3b7-488a-af50-1daee7dcbaad-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:27:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Acquiring lock "cinder-quobyte-8df254ca-a3b7-488a-af50-1daee7dcbaad" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:27:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Lock "cinder-quobyte-8df254ca-a3b7-488a-af50-1daee7dcbaad" acquired by "delete_volume" :: waited 0.047s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:27:49 devstack cinder-volume[87769]: INFO oslo.privsep.daemon [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu4d_4wft/privsep.sock'] Jul 17 15:27:49 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu4d_4wft/privsep.sock Jul 17 15:27:49 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:27:51 devstack cinder-volume[87769]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 17 15:27:51 devstack cinder-volume[87769]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 15:27:51 devstack cinder-volume[87769]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 17 15:27:51 devstack cinder-volume[87769]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 15:27:51 devstack cinder-volume[87769]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 17 15:27:51 devstack cinder-volume[87769]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 17 15:27:51 devstack cinder-volume[87769]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 15:27:51 devstack cinder-volume[87769]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 15:27:51 devstack cinder-volume[87769]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 17 15:27:51 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Jul 17 15:27:51 devstack cinder-volume[87769]: INFO oslo.privsep.daemon [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Spawned new privsep daemon via rootwrap Jul 17 15:27:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Accepted privsep connection to /tmp/tmpu4d_4wft/privsep.sock {{(pid=87769) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 17 15:27:51 devstack cinder-volume[87769]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 17 15:27:51 devstack cinder-volume[87769]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 17 15:27:51 devstack cinder-volume[87769]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 17 15:27:51 devstack cinder-volume[87769]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88873 Jul 17 15:27:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[07651c26-7742-447a-b7b2-2e2a802dc926]: (2,) {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:27:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fafaf27-f7b0-4784-b7cd-4dbb5072c51c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:27:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:27:52 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad Jul 17 15:27:52 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:27:52 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Jul 17 15:27:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad" returned: 0 in 0.671s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:27:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:27:52 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad Jul 17 15:27:52 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:27:53 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Jul 17 15:27:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8df254ca-a3b7-488a-af50-1daee7dcbaad" returned: 0 in 0.616s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:27:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Lock "cinder-quobyte-8df254ca-a3b7-488a-af50-1daee7dcbaad" released by "delete_volume" :: held 3.853s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:27:53 devstack cinder-volume[87769]: WARNING cinder.quota [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:27:53 devstack cinder-volume[87769]: WARNING cinder.quota [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:27:53 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Created reservations ['e241884c-2451-42df-86e5-f0eda372d802', '9d7f0ea2-239c-43b8-80d7-7ca47ba0f185', '30cfba3a-d985-44dc-a995-4f6152df060b', '870faa24-7456-4963-ad95-28776389c29f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:27:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:27:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:27:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:27:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:27:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:27:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:27:53 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:27:53 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:27:54 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Jul 17 15:27:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.790s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:27:54 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:27:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Deleted volume successfully. Jul 17 15:27:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7b77e4ea-5d86-4189-9031-209b8e6c4e42 tempest-VolumesAdminNegativeTest-659650382 None] Lock "cinder-8df254ca-a3b7-488a-af50-1daee7dcbaad-delete_volume" released by "delete_volume" :: held 5.330s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Flow 'volume_create_manager' (f1a75cfd-c486-4cc9-ade5-8a928c668fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cb9457-4e00-4627-8673-2833d03a4888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cb9457-4e00-4627-8673-2833d03a4888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1931790019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29576d1d-4356-4d9b-80a8-fa9ed2465adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728363661443da946cb3ea5d22940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:28:00Z,use_quota=True,user_id='c0b0e6cd3507461796725d9b7d97a319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fa45ee-3a84-427f-847e-d7ee38f9a31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fa45ee-3a84-427f-847e-d7ee38f9a31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d9fbf2-db59-450f-8f2b-194a2c60e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d9fbf2-db59-450f-8f2b-194a2c60e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29576d1d-4356-4d9b-80a8-fa9ed2465adc', 'volume_name': 'volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6285d9-b497-460a-b4d9-c06ab0ab041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6285d9-b497-460a-b4d9-c06ab0ab041b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17414a2-6b56-45bd-9d93-c8d37a079877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:27:59 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Volume 29576d1d-4356-4d9b-80a8-fa9ed2465adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc', 'volume_size': 1} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1931790019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29576d1d-4356-4d9b-80a8-fa9ed2465adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728363661443da946cb3ea5d22940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:28:00Z,use_quota=True,user_id='c0b0e6cd3507461796725d9b7d97a319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Creating volume 29576d1d-4356-4d9b-80a8-fa9ed2465adc {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:27:59 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:27:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:27:59 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc 1073741824 Jul 17 15:27:59 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:00 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc 1073741824" returned: 0 in 0.670s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:00 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc Jul 17 15:28:00 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:00 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc" returned: 0 in 0.324s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:28:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17414a2-6b56-45bd-9d93-c8d37a079877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0357dec-4d8c-44ed-8ca6-715aeb4bff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:00 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Volume volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc (29576d1d-4356-4d9b-80a8-fa9ed2465adc): created successfully Jul 17 15:28:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0357dec-4d8c-44ed-8ca6-715aeb4bff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Flow 'volume_create_manager' (f1a75cfd-c486-4cc9-ade5-8a928c668fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:28:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-28c5fdb7-429b-4460-be81-7e9fef057133 tempest-ServersNegativeTestJSON-132200181 None] Created volume successfully. Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Flow 'volume_create_manager' (7956b36a-6ce0-462c-a23b-cfa6024fd859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0065a1c2-6009-4167-b80b-2956e5b3f3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0065a1c2-6009-4167-b80b-2956e5b3f3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-154000253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea3155d-07db-469a-bb4e-08b986f6c6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728363661443da946cb3ea5d22940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:28:07Z,use_quota=True,user_id='c0b0e6cd3507461796725d9b7d97a319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2458b13a-687b-4f5e-a612-a355aa73dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2458b13a-687b-4f5e-a612-a355aa73dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e9f63c-a04a-4267-be09-02a98518fab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e9f63c-a04a-4267-be09-02a98518fab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea3155d-07db-469a-bb4e-08b986f6c6e2', 'volume_name': 'volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbf78af-e9c7-452f-bdb2-56d3ed977c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbf78af-e9c7-452f-bdb2-56d3ed977c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0950cb7d-6cf5-4cf4-b8be-4b47ee5e22c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:07 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Volume 6ea3155d-07db-469a-bb4e-08b986f6c6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2', 'volume_size': 1} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-154000253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea3155d-07db-469a-bb4e-08b986f6c6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728363661443da946cb3ea5d22940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:28:07Z,use_quota=True,user_id='c0b0e6cd3507461796725d9b7d97a319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Creating volume 6ea3155d-07db-469a-bb4e-08b986f6c6e2 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:28:07 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:07 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 1073741824 Jul 17 15:28:07 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:07 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 1073741824" returned: 0 in 0.586s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:08 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 Jul 17 15:28:08 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:08 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2" returned: 0 in 0.384s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:28:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0950cb7d-6cf5-4cf4-b8be-4b47ee5e22c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e6ec42-1fe8-416a-9eef-96afe03b8762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:08 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Volume volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 (6ea3155d-07db-469a-bb4e-08b986f6c6e2): created successfully Jul 17 15:28:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e6ec42-1fe8-416a-9eef-96afe03b8762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Flow 'volume_create_manager' (7956b36a-6ce0-462c-a23b-cfa6024fd859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:28:08 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0b809335-491b-4b73-a7d7-faabb42b3623 tempest-ServersNegativeTestJSON-132200181 None] Created volume successfully. Jul 17 15:28:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "cinder-6ea3155d-07db-469a-bb4e-08b986f6c6e2-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:28:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Lock "cinder-6ea3155d-07db-469a-bb4e-08b986f6c6e2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:28:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "cinder-quobyte-6ea3155d-07db-469a-bb4e-08b986f6c6e2" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:28:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Lock "cinder-quobyte-6ea3155d-07db-469a-bb4e-08b986f6c6e2" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:28:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe38567-2d54-4d36-8806-eb2e7d265f8b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:28:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:10 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 Jul 17 15:28:10 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:10 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2" returned: 0 in 0.511s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:10 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2 Jul 17 15:28:10 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:10 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ea3155d-07db-469a-bb4e-08b986f6c6e2" returned: 0 in 0.390s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Lock "cinder-quobyte-6ea3155d-07db-469a-bb4e-08b986f6c6e2" released by "delete_volume" :: held 0.958s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Created reservations ['57a973bb-d75a-42dc-82ab-5814057d5e41', '79b25765-23e8-4968-80ff-fd9162938daf', '94a6f15a-ca03-40ec-b38e-06a0e6f8c5db', 'e5b6fad7-11ff-46ff-81c4-db7690b668e9'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:11 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:28:11 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:11 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.336s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:28:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Deleted volume successfully. Jul 17 15:28:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95ccd544-809e-4990-b94d-c39fd5b028e6 tempest-ServersNegativeTestJSON-132200181 None] Lock "cinder-6ea3155d-07db-469a-bb4e-08b986f6c6e2-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:28:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "cinder-29576d1d-4356-4d9b-80a8-fa9ed2465adc-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:28:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Lock "cinder-29576d1d-4356-4d9b-80a8-fa9ed2465adc-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:28:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "cinder-quobyte-29576d1d-4356-4d9b-80a8-fa9ed2465adc" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:28:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Lock "cinder-quobyte-29576d1d-4356-4d9b-80a8-fa9ed2465adc" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:28:12 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[075be17d-daaa-4b53-ae54-d2492fb7ccd7]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:28:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:12 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc Jul 17 15:28:12 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:13 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc" returned: 0 in 0.597s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:13 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc Jul 17 15:28:13 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:13 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-29576d1d-4356-4d9b-80a8-fa9ed2465adc" returned: 0 in 0.427s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Lock "cinder-quobyte-29576d1d-4356-4d9b-80a8-fa9ed2465adc" released by "delete_volume" :: held 1.087s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Created reservations ['0226b14d-a3b5-4e87-8e85-3e2d5d4f4a49', 'e5509071-20e8-4167-83b0-d67dc6be78b7', '5c064498-5123-41da-aaab-19e1f244ea42', '4767dfae-7b9c-4835-b789-00bea8615b84'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:13 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:28:13 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:13 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.300s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:13 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:28:13 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Deleted volume successfully. Jul 17 15:28:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcdcce38-720a-4308-a92d-6c330ae55070 tempest-ServersNegativeTestJSON-132200181 None] Lock "cinder-29576d1d-4356-4d9b-80a8-fa9ed2465adc-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:28:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:28:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:28:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:28:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:22 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:28:22 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:23 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.663s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:28:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:28:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 8 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:28:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:28:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=5 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:28:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=24,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:28:28 devstack cinder-volume[87769]: WARNING py.warnings [req-6e903668-5f54-4ade-9475-e4c1126a236c req-628bb2f2-4364-4366-91f8-089c0a5528ae tempest-TaggedAttachmentsTest-1858231890 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 17 15:28:28 devstack cinder-volume[87769]: .first() Jul 17 15:28:28 devstack cinder-volume[87769]: Jul 17 15:28:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-6e903668-5f54-4ade-9475-e4c1126a236c req-628bb2f2-4364-4366-91f8-089c0a5528ae tempest-TaggedAttachmentsTest-1858231890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-6e903668-5f54-4ade-9475-e4c1126a236c req-628bb2f2-4364-4366-91f8-089c0a5528ae tempest-TaggedAttachmentsTest-1858231890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-6e903668-5f54-4ade-9475-e4c1126a236c req-628bb2f2-4364-4366-91f8-089c0a5528ae tempest-TaggedAttachmentsTest-1858231890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:28 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-6e903668-5f54-4ade-9475-e4c1126a236c req-628bb2f2-4364-4366-91f8-089c0a5528ae tempest-TaggedAttachmentsTest-1858231890 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-8959ad18-f311-417a-961e-0cc134a5616b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '863d9678-3de8-41a9-8007-6f59a747b014', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:28:28 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-6e903668-5f54-4ade-9475-e4c1126a236c req-628bb2f2-4364-4366-91f8-089c0a5528ae tempest-TaggedAttachmentsTest-1858231890 None] attachment_update completed successfully. Jul 17 15:28:33 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-230c8ee2-0638-4206-9201-9a662612fa0b req-05886e9f-0fa0-48b5-b181-357a37dfc7d3 tempest-TaggedAttachmentsTest-1858231890 None] Terminate volume connection completed successfully. Jul 17 15:28:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-230c8ee2-0638-4206-9201-9a662612fa0b req-05886e9f-0fa0-48b5-b181-357a37dfc7d3 tempest-TaggedAttachmentsTest-1858231890 None] Deleting attachment 863d9678-3de8-41a9-8007-6f59a747b014. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:28:43 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:28:43 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Flow 'volume_create_manager' (66ea4beb-10ec-4005-aa93-3d786c972bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a54ac74-23ae-4f27-bdce-1317be2b1645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a54ac74-23ae-4f27-bdce-1317be2b1645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1649829691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47d0407-86fc-4bdc-851b-43769eab2a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8997153aa6249d3acf9e10ca42322af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:28:47Z,use_quota=True,user_id='2811632312a84150bdef99434622b169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e202ebf8-e63c-4480-94c9-939ae433cff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e202ebf8-e63c-4480-94c9-939ae433cff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbb40f1-31b4-445b-8012-904d277ef37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbb40f1-31b4-445b-8012-904d277ef37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47d0407-86fc-4bdc-851b-43769eab2a64', 'volume_name': 'volume-a47d0407-86fc-4bdc-851b-43769eab2a64', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0338ff98-2381-409d-9a6b-6790175c5057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0338ff98-2381-409d-9a6b-6790175c5057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4522a3f-bc40-4081-bc10-6f26b01a03e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:46 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Volume a47d0407-86fc-4bdc-851b-43769eab2a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47d0407-86fc-4bdc-851b-43769eab2a64', 'volume_size': 1} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1649829691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47d0407-86fc-4bdc-851b-43769eab2a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8997153aa6249d3acf9e10ca42322af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:28:47Z,use_quota=True,user_id='2811632312a84150bdef99434622b169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Creating volume a47d0407-86fc-4bdc-851b-43769eab2a64 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:28:46 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:28:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:46 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64 1073741824 Jul 17 15:28:46 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:47 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64 1073741824" returned: 0 in 1.172s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:48 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64 Jul 17 15:28:48 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:48 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64" returned: 0 in 0.368s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:28:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4522a3f-bc40-4081-bc10-6f26b01a03e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47d0407-86fc-4bdc-851b-43769eab2a64', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19598da3-6820-4858-aa1e-054bb6d96719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:48 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Volume volume-a47d0407-86fc-4bdc-851b-43769eab2a64 (a47d0407-86fc-4bdc-851b-43769eab2a64): created successfully Jul 17 15:28:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19598da3-6820-4858-aa1e-054bb6d96719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Flow 'volume_create_manager' (66ea4beb-10ec-4005-aa93-3d786c972bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:28:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-79452e75-479d-4b1e-95aa-8f583ab8d03d tempest-ServerActionsTestOtherA-1564946866 None] Created volume successfully. Jul 17 15:28:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Acquiring lock "cinder-8959ad18-f311-417a-961e-0cc134a5616b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:28:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Lock "cinder-8959ad18-f311-417a-961e-0cc134a5616b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:28:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Acquiring lock "cinder-quobyte-8959ad18-f311-417a-961e-0cc134a5616b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:28:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Lock "cinder-quobyte-8959ad18-f311-417a-961e-0cc134a5616b" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:28:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8779ca-4b7f-434d-aedb-2314bb53de5e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:28:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:53 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b Jul 17 15:28:53 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:54 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b" returned: 0 in 0.779s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:54 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b Jul 17 15:28:54 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Flow 'volume_create_manager' (ed4d1d68-35dd-4514-94fa-3d07953f8b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525c487e-6073-44f8-b66a-5443e638f695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525c487e-6073-44f8-b66a-5443e638f695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1502237858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809eea63-a7cd-4755-a75a-2a4761628029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c22527168548afa934727f3c90c553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:28:54Z,use_quota=True,user_id='b7a205ed7ec249828dd25bce27ab8f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b1fdd7-8496-42ab-b54c-2e64924de81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b1fdd7-8496-42ab-b54c-2e64924de81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60502257-a5ea-4aae-8fed-9633fea032b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60502257-a5ea-4aae-8fed-9633fea032b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809eea63-a7cd-4755-a75a-2a4761628029', 'volume_name': 'volume-809eea63-a7cd-4755-a75a-2a4761628029', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dde722c-c225-44d2-9019-21fc9607ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dde722c-c225-44d2-9019-21fc9607ecab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a357be-2548-47d5-867b-2028e4a84229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:54 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Volume 809eea63-a7cd-4755-a75a-2a4761628029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809eea63-a7cd-4755-a75a-2a4761628029', 'volume_size': 1} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1502237858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809eea63-a7cd-4755-a75a-2a4761628029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c22527168548afa934727f3c90c553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:28:54Z,use_quota=True,user_id='b7a205ed7ec249828dd25bce27ab8f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Creating volume 809eea63-a7cd-4755-a75a-2a4761628029 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:28:54 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:54 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029 1073741824 Jul 17 15:28:54 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:54 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8959ad18-f311-417a-961e-0cc134a5616b" returned: 0 in 0.354s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Lock "cinder-quobyte-8959ad18-f311-417a-961e-0cc134a5616b" released by "delete_volume" :: held 1.218s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Created reservations ['4b90d483-a1e2-4320-8a91-5b3ea7d838b3', '9d46cb4e-8029-47c1-b30c-dce45d4d1d4a', 'fbb8466e-9779-45f4-a659-c19eebb79496', '236c8212-f662-4340-967f-a1bbba1dd9f8'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:55 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:28:55 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:55 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029 1073741824" returned: 0 in 0.757s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:28:55 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029 Jul 17 15:28:55 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:28:55 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.635s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:28:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Deleted volume successfully. Jul 17 15:28:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-807d1cee-0f41-4e09-8c60-b15e8d05093c tempest-TaggedAttachmentsTest-1858231890 None] Lock "cinder-8959ad18-f311-417a-961e-0cc134a5616b-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:28:56 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Jul 17 15:28:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029" returned: 0 in 0.684s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:28:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:28:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a357be-2548-47d5-867b-2028e4a84229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809eea63-a7cd-4755-a75a-2a4761628029', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527adfa6-4203-4f95-bb6b-228ec1b7d059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:28:56 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Volume volume-809eea63-a7cd-4755-a75a-2a4761628029 (809eea63-a7cd-4755-a75a-2a4761628029): created successfully Jul 17 15:28:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527adfa6-4203-4f95-bb6b-228ec1b7d059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:28:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Flow 'volume_create_manager' (ed4d1d68-35dd-4514-94fa-3d07953f8b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:28:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-24538492-c2d2-44e8-9f8d-21bd5127aa54 tempest-DeleteServersTestJSON-697275540 None] Created volume successfully. Jul 17 15:28:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-01b41095-6ac2-406f-8df0-83ef40cab974 req-48e0761f-1f88-4be1-93a3-e4e981150c4a tempest-DeleteServersTestJSON-697275540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:28:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-01b41095-6ac2-406f-8df0-83ef40cab974 req-48e0761f-1f88-4be1-93a3-e4e981150c4a tempest-DeleteServersTestJSON-697275540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:28:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-01b41095-6ac2-406f-8df0-83ef40cab974 req-48e0761f-1f88-4be1-93a3-e4e981150c4a tempest-DeleteServersTestJSON-697275540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:28:58 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-01b41095-6ac2-406f-8df0-83ef40cab974 req-48e0761f-1f88-4be1-93a3-e4e981150c4a tempest-DeleteServersTestJSON-697275540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-809eea63-a7cd-4755-a75a-2a4761628029', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bc161c3-47df-4e73-9159-c43dea87cd6a', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:28:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-01b41095-6ac2-406f-8df0-83ef40cab974 req-48e0761f-1f88-4be1-93a3-e4e981150c4a tempest-DeleteServersTestJSON-697275540 None] attachment_update completed successfully. Jul 17 15:29:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-68fa5320-6f3f-4e2e-9a7e-5d929ad7b685 req-30c8c156-9f47-478a-af4b-c362110c5ffa tempest-DeleteServersTestJSON-697275540 None] Terminate volume connection completed successfully. Jul 17 15:29:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-68fa5320-6f3f-4e2e-9a7e-5d929ad7b685 req-30c8c156-9f47-478a-af4b-c362110c5ffa tempest-DeleteServersTestJSON-697275540 None] Deleting attachment 7bc161c3-47df-4e73-9159-c43dea87cd6a. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:29:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Acquiring lock "cinder-809eea63-a7cd-4755-a75a-2a4761628029-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:29:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Lock "cinder-809eea63-a7cd-4755-a75a-2a4761628029-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:29:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Acquiring lock "cinder-quobyte-809eea63-a7cd-4755-a75a-2a4761628029" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:29:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Lock "cinder-quobyte-809eea63-a7cd-4755-a75a-2a4761628029" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:29:05 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[770e0089-6b95-4837-b352-ffd7191db90e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:29:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:29:05 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029 Jul 17 15:29:05 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:29:06 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Jul 17 15:29:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029" returned: 0 in 0.936s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:29:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:29:06 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029 Jul 17 15:29:06 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:29:07 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Jul 17 15:29:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809eea63-a7cd-4755-a75a-2a4761628029" returned: 0 in 0.685s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:29:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Lock "cinder-quobyte-809eea63-a7cd-4755-a75a-2a4761628029" released by "delete_volume" :: held 1.704s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:29:07 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Created reservations ['f9a9cf68-b1db-4a1d-bd54-63fc61515fbc', '2869f5a0-ef06-4211-a7e0-c3f8dd923f30', 'cdace74f-719f-42e6-8a8f-658d6b6be10a', '362718e0-9c05-4622-b03c-754f7f47a067'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:29:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:29:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:29:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:29:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:29:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:29:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:29:07 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:29:07 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:29:08 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Jul 17 15:29:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.556s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:29:08 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:29:08 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Deleted volume successfully. Jul 17 15:29:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a106978c-9ca3-4d90-8f6a-ec18ba153089 tempest-DeleteServersTestJSON-697275540 None] Lock "cinder-809eea63-a7cd-4755-a75a-2a4761628029-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:29:17 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:29:18 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=25,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:29:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:29:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:29:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:29:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:29:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:29:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:29:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:29:22 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:29:22 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:29:23 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Jul 17 15:29:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.284s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:29:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:29:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:29:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 8 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:29:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:29:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-f9377757-518f-4a05-bf03-003025561104 req-e6a652af-8133-4e89-9678-1d16a9bb0974 tempest-ServerActionsTestOtherA-1564946866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:29:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-f9377757-518f-4a05-bf03-003025561104 req-e6a652af-8133-4e89-9678-1d16a9bb0974 tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:29:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-f9377757-518f-4a05-bf03-003025561104 req-e6a652af-8133-4e89-9678-1d16a9bb0974 tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:29:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-f9377757-518f-4a05-bf03-003025561104 req-e6a652af-8133-4e89-9678-1d16a9bb0974 tempest-ServerActionsTestOtherA-1564946866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-a47d0407-86fc-4bdc-851b-43769eab2a64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96d7dcfe-9be3-4e96-aa47-4f6b634dc756', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:29:35 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-f9377757-518f-4a05-bf03-003025561104 req-e6a652af-8133-4e89-9678-1d16a9bb0974 tempest-ServerActionsTestOtherA-1564946866 None] attachment_update completed successfully. Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Flow 'volume_create_manager' (9ff159fb-84ed-4d92-81ce-5144f159d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2f2b95-379a-4335-a0b5-3805cc135cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2f2b95-379a-4335-a0b5-3805cc135cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2096389135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d943bd8f-d1be-4ee8-829a-86a0b8fbeb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac9ebac33246d6b7ef6c5c440fc903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:29:37Z,use_quota=True,user_id='08c12e343e55409c9388f040105e0a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a3ebd2-3387-4b41-bfac-b2d91b5026da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a3ebd2-3387-4b41-bfac-b2d91b5026da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11cc7d1-393e-48bf-a5bb-bfeef2512985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11cc7d1-393e-48bf-a5bb-bfeef2512985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd943bd8f-d1be-4ee8-829a-86a0b8fbeb36', 'volume_name': 'volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2f9de6-dc33-40bf-b9cc-86ab2a556f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2f9de6-dc33-40bf-b9cc-86ab2a556f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b7d0f3-252a-4bbf-b497-9f8e2e682241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:29:36 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Volume d943bd8f-d1be-4ee8-829a-86a0b8fbeb36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36', 'volume_size': 1} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2096389135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d943bd8f-d1be-4ee8-829a-86a0b8fbeb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac9ebac33246d6b7ef6c5c440fc903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:29:37Z,use_quota=True,user_id='08c12e343e55409c9388f040105e0a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Creating volume d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:29:36 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:29:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:29:36 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 1073741824 Jul 17 15:29:36 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:29:37 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Jul 17 15:29:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 1073741824" returned: 0 in 0.734s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:29:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:29:37 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 Jul 17 15:29:37 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:29:38 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Jul 17 15:29:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36" returned: 0 in 0.579s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:29:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:29:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:29:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b7d0f3-252a-4bbf-b497-9f8e2e682241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:29:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818042d5-0049-4120-bc58-b0a004354d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:29:38 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Volume volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 (d943bd8f-d1be-4ee8-829a-86a0b8fbeb36): created successfully Jul 17 15:29:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818042d5-0049-4120-bc58-b0a004354d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:29:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Flow 'volume_create_manager' (9ff159fb-84ed-4d92-81ce-5144f159d607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:29:38 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-07de3af4-792b-47d8-b476-11d63453ca08 tempest-AttachVolumeTestJSON-312816881 None] Created volume successfully. Jul 17 15:29:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-96fa84d8-ddd5-431e-88f9-5a743d57808e req-34f9357b-e52b-4db0-a906-e10f10033295 tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:29:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-96fa84d8-ddd5-431e-88f9-5a743d57808e req-34f9357b-e52b-4db0-a906-e10f10033295 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:29:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-96fa84d8-ddd5-431e-88f9-5a743d57808e req-34f9357b-e52b-4db0-a906-e10f10033295 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:29:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-96fa84d8-ddd5-431e-88f9-5a743d57808e req-34f9357b-e52b-4db0-a906-e10f10033295 tempest-AttachVolumeTestJSON-312816881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd156c72d-c2b1-4566-92c7-c3c42b29b02e', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:29:40 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-96fa84d8-ddd5-431e-88f9-5a743d57808e req-34f9357b-e52b-4db0-a906-e10f10033295 tempest-AttachVolumeTestJSON-312816881 None] attachment_update completed successfully. Jul 17 15:29:40 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-e92dc870-b215-434e-9232-35377b668244 req-c954ce9d-d2ec-4ecc-8356-d860ed244008 tempest-ServerActionsTestOtherA-1564946866 None] Terminate volume connection completed successfully. Jul 17 15:29:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e92dc870-b215-434e-9232-35377b668244 req-c954ce9d-d2ec-4ecc-8356-d860ed244008 tempest-ServerActionsTestOtherA-1564946866 None] Deleting attachment 96d7dcfe-9be3-4e96-aa47-4f6b634dc756. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:29:41 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-96fa84d8-ddd5-431e-88f9-5a743d57808e req-ff9ab2ff-268f-435a-9f7a-d916139db4fd tempest-AttachVolumeTestJSON-312816881 None] Terminate volume connection completed successfully. Jul 17 15:29:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-96fa84d8-ddd5-431e-88f9-5a743d57808e req-ff9ab2ff-268f-435a-9f7a-d916139db4fd tempest-AttachVolumeTestJSON-312816881 None] Deleting attachment d156c72d-c2b1-4566-92c7-c3c42b29b02e. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:29:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e92dc870-b215-434e-9232-35377b668244 req-b9a85bfe-3b4f-475f-9338-cba71e3a4bab tempest-ServerActionsTestOtherA-1564946866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:29:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e92dc870-b215-434e-9232-35377b668244 req-b9a85bfe-3b4f-475f-9338-cba71e3a4bab tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:29:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e92dc870-b215-434e-9232-35377b668244 req-b9a85bfe-3b4f-475f-9338-cba71e3a4bab tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:29:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e92dc870-b215-434e-9232-35377b668244 req-b9a85bfe-3b4f-475f-9338-cba71e3a4bab tempest-ServerActionsTestOtherA-1564946866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-a47d0407-86fc-4bdc-851b-43769eab2a64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3c801b8-eab3-49af-92ae-025f0044f400', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:29:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-e92dc870-b215-434e-9232-35377b668244 req-b9a85bfe-3b4f-475f-9338-cba71e3a4bab tempest-ServerActionsTestOtherA-1564946866 None] attachment_update completed successfully. Jul 17 15:29:52 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=24,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:29:52 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=23,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Flow 'volume_create_manager' (36f0620a-53ec-4ecc-8a41-533323882fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa3d227-2f86-460e-9eab-e96b373d176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa3d227-2f86-460e-9eab-e96b373d176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-472133080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9203ddbf35434a25bc1a1502149c93d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:03Z,use_quota=True,user_id='1a1b46a8edf5491caba89d153d4d2c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff8a37e-e7e1-4d10-9726-4c5cea17668b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff8a37e-e7e1-4d10-9726-4c5cea17668b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8170dd1-aaf9-4937-aae1-a0a3c7ec1a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8170dd1-aaf9-4937-aae1-a0a3c7ec1a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6', 'volume_name': 'volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4362d6c-a66c-4070-a89d-9c4d90bc6000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4362d6c-a66c-4070-a89d-9c4d90bc6000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da7d020a-5bb6-4282-b8a6-a65e6b658611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:03 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Volume 5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6', 'volume_size': 1} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-472133080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9203ddbf35434a25bc1a1502149c93d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:03Z,use_quota=True,user_id='1a1b46a8edf5491caba89d153d4d2c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Creating volume 5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:30:03 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:03 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 1073741824 Jul 17 15:30:03 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:03 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 1073741824" returned: 0 in 0.475s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:03 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 Jul 17 15:30:03 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:04 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6" returned: 0 in 0.328s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:30:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da7d020a-5bb6-4282-b8a6-a65e6b658611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8ca9e2-d891-4869-ad5e-f493fa8b1b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:04 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Volume volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 (5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6): created successfully Jul 17 15:30:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8ca9e2-d891-4869-ad5e-f493fa8b1b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Flow 'volume_create_manager' (36f0620a-53ec-4ecc-8a41-533323882fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1514fc46-f5bb-430a-a56a-e30ae1cdddc5 tempest-ServerRescueNegativeTestJSON-427427533 None] Created volume successfully. Jul 17 15:30:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Acquiring lock "cinder-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "cinder-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Acquiring lock "cinder-quobyte-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "cinder-quobyte-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:13 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7f399b-efb0-470e-922b-2947d41ce7fa]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:30:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:13 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 Jul 17 15:30:13 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:14 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6" returned: 0 in 0.542s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:14 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6 Jul 17 15:30:14 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:14 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6" returned: 0 in 0.530s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "cinder-quobyte-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6" released by "delete_volume" :: held 1.146s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Created reservations ['f79a717e-62c8-462b-8ece-6ba7bc5ab66a', 'f2b98d17-631b-42cc-adc2-e685f7bed5a2', '24324418-30c7-4709-af8a-65c9996f6452', 'b81c174e-7b69-4532-8d12-d013b33eeb2b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:14 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:30:14 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:15 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.417s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:15 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:30:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Deleted volume successfully. Jul 17 15:30:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051a453d-e189-487c-ae7c-3882d9c7baf7 tempest-ServerRescueNegativeTestJSON-427427533 None] Lock "cinder-5b7c13a5-ce1a-4e56-b45c-9c46703b8ef6-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:30:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:22 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:30:22 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:23 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.280s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:30:25 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:30:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:30:26 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:30:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Flow 'volume_create_manager' (27786bdb-8538-47fe-8d77-e232ebda5cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e509d95-8bed-4fcf-abb7-c0a47ee2bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e509d95-8bed-4fcf-abb7-c0a47ee2bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1107925181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daff0d63-1874-41dc-a83f-e0da3df30cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0f9cc39b6f41b3ab5e059c50a212ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:27Z,use_quota=True,user_id='9630abd9a545471abfb6282574f1883c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587bfd5e-700c-4369-a210-6b7b2b4769d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587bfd5e-700c-4369-a210-6b7b2b4769d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7055e2ab-e47f-4875-9964-e44042bca222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7055e2ab-e47f-4875-9964-e44042bca222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daff0d63-1874-41dc-a83f-e0da3df30cfc', 'volume_name': 'volume-daff0d63-1874-41dc-a83f-e0da3df30cfc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8f0b2f-7af2-4a3b-8c56-a8b6cfd3e929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8f0b2f-7af2-4a3b-8c56-a8b6cfd3e929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61321cc0-e353-45d8-88e0-72c1586efc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:27 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Volume daff0d63-1874-41dc-a83f-e0da3df30cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daff0d63-1874-41dc-a83f-e0da3df30cfc', 'volume_size': 1} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1107925181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daff0d63-1874-41dc-a83f-e0da3df30cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0f9cc39b6f41b3ab5e059c50a212ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:27Z,use_quota=True,user_id='9630abd9a545471abfb6282574f1883c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Creating volume daff0d63-1874-41dc-a83f-e0da3df30cfc {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:30:27 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:27 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc 1073741824 Jul 17 15:30:27 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:27 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc 1073741824" returned: 0 in 0.455s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:27 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc Jul 17 15:30:27 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:27 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc" returned: 0 in 0.253s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61321cc0-e353-45d8-88e0-72c1586efc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daff0d63-1874-41dc-a83f-e0da3df30cfc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0283d81-f1ee-4b70-a364-158b462e055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:27 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Volume volume-daff0d63-1874-41dc-a83f-e0da3df30cfc (daff0d63-1874-41dc-a83f-e0da3df30cfc): created successfully Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0283d81-f1ee-4b70-a364-158b462e055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Flow 'volume_create_manager' (27786bdb-8538-47fe-8d77-e232ebda5cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:27 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f62a5638-8c71-4b1d-98c4-c258cbc5bbd3 tempest-AttachVolumeShelveTestJSON-311453147 None] Created volume successfully. Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Flow 'volume_create_manager' (0c7545a0-949f-4d4a-a47b-83d7c2fda405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c483459f-4f41-4b31-a071-9eac317a3d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c483459f-4f41-4b31-a071-9eac317a3d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1209664979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0175136-6c63-4694-a19c-c0c24d8bc064,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d86841d842a14d769e897e21b7cadc8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:28Z,use_quota=True,user_id='d002a4d1e3624e8abbcb75b5922cb405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a835d71-2df3-4405-8383-08d7d728c0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a835d71-2df3-4405-8383-08d7d728c0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527abbab-c7ec-4457-9d75-e1f4646cabbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527abbab-c7ec-4457-9d75-e1f4646cabbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0175136-6c63-4694-a19c-c0c24d8bc064', 'volume_name': 'volume-d0175136-6c63-4694-a19c-c0c24d8bc064', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cb6a2b-6144-43b7-abbb-6f025bdbe036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cb6a2b-6144-43b7-abbb-6f025bdbe036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2722d82e-996d-48ef-8613-8f889493e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:27 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Volume d0175136-6c63-4694-a19c-c0c24d8bc064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0175136-6c63-4694-a19c-c0c24d8bc064', 'volume_size': 1} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1209664979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0175136-6c63-4694-a19c-c0c24d8bc064,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d86841d842a14d769e897e21b7cadc8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:28Z,use_quota=True,user_id='d002a4d1e3624e8abbcb75b5922cb405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Creating volume d0175136-6c63-4694-a19c-c0c24d8bc064 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:30:28 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:28 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064 1073741824 Jul 17 15:30:28 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:28 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064 1073741824" returned: 0 in 0.433s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:28 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064 Jul 17 15:30:28 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:28 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064" returned: 0 in 0.274s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2722d82e-996d-48ef-8613-8f889493e67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0175136-6c63-4694-a19c-c0c24d8bc064', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f43d4a-71f7-462f-8769-4324631410b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:28 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Volume volume-d0175136-6c63-4694-a19c-c0c24d8bc064 (d0175136-6c63-4694-a19c-c0c24d8bc064): created successfully Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f43d4a-71f7-462f-8769-4324631410b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Flow 'volume_create_manager' (0c7545a0-949f-4d4a-a47b-83d7c2fda405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:28 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5fdc6fae-3cf9-4581-a2ec-4262b01378f4 tempest-VolumesTestJSON-409668279 None] Created volume successfully. Jul 17 15:30:28 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-328390f9-706c-4a38-8707-35fe09c1ba4b req-a416a7a9-57ab-4316-bda6-d37ce2f5a31d tempest-ServerActionsTestOtherA-1564946866 None] Terminate volume connection completed successfully. Jul 17 15:30:28 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-328390f9-706c-4a38-8707-35fe09c1ba4b req-a416a7a9-57ab-4316-bda6-d37ce2f5a31d tempest-ServerActionsTestOtherA-1564946866 None] Deleting attachment b3c801b8-eab3-49af-92ae-025f0044f400. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Flow 'volume_create_manager' (2fab7651-f3ce-4adf-a120-64080952d3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7016b6a4-dc19-4299-93e3-33f570dd0576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7016b6a4-dc19-4299-93e3-33f570dd0576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-525753687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd29e026-5e46-46c8-ab23-a97e1ba900c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d86841d842a14d769e897e21b7cadc8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:29Z,use_quota=True,user_id='d002a4d1e3624e8abbcb75b5922cb405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ee0d41-e235-4a23-9db9-a0a42c05e259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ee0d41-e235-4a23-9db9-a0a42c05e259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d59dbb4-652a-4afe-a8ad-05d423352c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d59dbb4-652a-4afe-a8ad-05d423352c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd29e026-5e46-46c8-ab23-a97e1ba900c7', 'volume_name': 'volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cacc9cd-05b5-4cae-ac87-6bba05eaaa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cacc9cd-05b5-4cae-ac87-6bba05eaaa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a247900f-5fbf-4061-b45e-53a9a7121921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:29 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Volume fd29e026-5e46-46c8-ab23-a97e1ba900c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7', 'volume_size': 1} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-525753687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd29e026-5e46-46c8-ab23-a97e1ba900c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d86841d842a14d769e897e21b7cadc8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:29Z,use_quota=True,user_id='d002a4d1e3624e8abbcb75b5922cb405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Creating volume fd29e026-5e46-46c8-ab23-a97e1ba900c7 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:30:29 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:30:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:29 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 1073741824 Jul 17 15:30:29 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:30 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 1073741824" returned: 0 in 0.543s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:30 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 Jul 17 15:30:30 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:30 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7" returned: 0 in 0.463s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:30:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a247900f-5fbf-4061-b45e-53a9a7121921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98cf6a35-11ee-4b03-a6d8-45a4dba3e5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:30 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Volume volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 (fd29e026-5e46-46c8-ab23-a97e1ba900c7): created successfully Jul 17 15:30:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98cf6a35-11ee-4b03-a6d8-45a4dba3e5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Flow 'volume_create_manager' (2fab7651-f3ce-4adf-a120-64080952d3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:30 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-45b0f627-b1ae-4e32-91d1-02d9d21e3c84 tempest-VolumesTestJSON-409668279 None] Created volume successfully. Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Flow 'volume_create_manager' (b70517c9-c961-43f9-942d-f39bc01bb87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05fbcb1-4220-4003-9149-49ffece40eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05fbcb1-4220-4003-9149-49ffece40eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1159900014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d9a984-a0c6-40d0-aba7-8bbe19774712,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d86841d842a14d769e897e21b7cadc8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:32Z,use_quota=True,user_id='d002a4d1e3624e8abbcb75b5922cb405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b336224-1bb6-4fd0-b34f-ddb50a3d2397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b336224-1bb6-4fd0-b34f-ddb50a3d2397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e463f6-e24c-4bcd-bd09-8e502bc8a4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e463f6-e24c-4bcd-bd09-8e502bc8a4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d9a984-a0c6-40d0-aba7-8bbe19774712', 'volume_name': 'volume-17d9a984-a0c6-40d0-aba7-8bbe19774712', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7f78dc-5f6c-4db0-90c7-ba0f37276fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7f78dc-5f6c-4db0-90c7-ba0f37276fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c43b36-a691-4e67-9c7d-862c2ea2500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:32 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Volume 17d9a984-a0c6-40d0-aba7-8bbe19774712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d9a984-a0c6-40d0-aba7-8bbe19774712', 'volume_size': 1} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1159900014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d9a984-a0c6-40d0-aba7-8bbe19774712,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d86841d842a14d769e897e21b7cadc8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:32Z,use_quota=True,user_id='d002a4d1e3624e8abbcb75b5922cb405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Creating volume 17d9a984-a0c6-40d0-aba7-8bbe19774712 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:30:32 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:30:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:32 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 1073741824 Jul 17 15:30:32 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:33 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 1073741824" returned: 0 in 0.510s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:33 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 Jul 17 15:30:33 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:33 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:30:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c43b36-a691-4e67-9c7d-862c2ea2500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d9a984-a0c6-40d0-aba7-8bbe19774712', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d76dbe0-e12b-468e-89a9-7d9f53bd679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:33 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Volume volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 (17d9a984-a0c6-40d0-aba7-8bbe19774712): created successfully Jul 17 15:30:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d76dbe0-e12b-468e-89a9-7d9f53bd679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Flow 'volume_create_manager' (b70517c9-c961-43f9-942d-f39bc01bb87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:33 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-714a8296-8427-4f2a-8f22-056082630afa tempest-VolumesTestJSON-409668279 None] Created volume successfully. Jul 17 15:30:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Acquiring lock "cinder-a47d0407-86fc-4bdc-851b-43769eab2a64-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Lock "cinder-a47d0407-86fc-4bdc-851b-43769eab2a64-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Acquiring lock "cinder-quobyte-a47d0407-86fc-4bdc-851b-43769eab2a64" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Lock "cinder-quobyte-a47d0407-86fc-4bdc-851b-43769eab2a64" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:34 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e568451a-3c9d-473f-a76a-1c0afd4b8666]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:30:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:34 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64 Jul 17 15:30:34 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:35 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64" returned: 0 in 0.445s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:35 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64 Jul 17 15:30:35 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:35 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a47d0407-86fc-4bdc-851b-43769eab2a64" returned: 0 in 0.276s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Lock "cinder-quobyte-a47d0407-86fc-4bdc-851b-43769eab2a64" released by "delete_volume" :: held 0.774s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Acquiring lock "cinder-17d9a984-a0c6-40d0-aba7-8bbe19774712-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Lock "cinder-17d9a984-a0c6-40d0-aba7-8bbe19774712-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Created reservations ['6d751b8b-f9ce-4f12-9c72-55f764e67f23', '80f655ce-c2cb-4f31-973a-e8a8e4f93874', 'bf212e7b-d5d7-4bb0-b6f9-dd2aae92bff7', '4493f622-4712-45df-aa7d-ca8259f68ba4'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Acquiring lock "cinder-quobyte-17d9a984-a0c6-40d0-aba7-8bbe19774712" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Lock "cinder-quobyte-17d9a984-a0c6-40d0-aba7-8bbe19774712" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f2f08c-c62b-4b37-8b6a-71e6b3de28fe]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:35 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:30:35 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:36 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 Jul 17 15:30:36 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:36 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.329s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:36 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:30:36 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Deleted volume successfully. Jul 17 15:30:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-337e978d-a802-4395-a0e8-62c119bfa6ae tempest-ServerActionsTestOtherA-1564946866 None] Lock "cinder-a47d0407-86fc-4bdc-851b-43769eab2a64-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:36 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712" returned: 0 in 0.506s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:36 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712 Jul 17 15:30:36 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:36 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17d9a984-a0c6-40d0-aba7-8bbe19774712" returned: 0 in 0.453s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Lock "cinder-quobyte-17d9a984-a0c6-40d0-aba7-8bbe19774712" released by "delete_volume" :: held 1.024s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Created reservations ['618c5def-c516-4ac4-b637-34c7518e69bd', 'ac8440f4-42f5-46f4-a522-f9efd034f0da', '03ef6c26-afec-4edd-bb72-96477705b206', '9af3a252-2bc4-48fb-a26c-a574f53004f7'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:37 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:30:37 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:37 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.404s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:30:37 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Deleted volume successfully. Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f0f0cbdd-373b-49bc-9add-f0ebd81df4b3 tempest-VolumesTestJSON-409668279 None] Lock "cinder-17d9a984-a0c6-40d0-aba7-8bbe19774712-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Acquiring lock "cinder-fd29e026-5e46-46c8-ab23-a97e1ba900c7-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Lock "cinder-fd29e026-5e46-46c8-ab23-a97e1ba900c7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Acquiring lock "cinder-quobyte-fd29e026-5e46-46c8-ab23-a97e1ba900c7" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Lock "cinder-quobyte-fd29e026-5e46-46c8-ab23-a97e1ba900c7" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb0c8b1-7950-4055-ad83-e50748478d94]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:38 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 Jul 17 15:30:38 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:38 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7" returned: 0 in 0.442s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:38 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7 Jul 17 15:30:38 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:38 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fd29e026-5e46-46c8-ab23-a97e1ba900c7" returned: 0 in 0.293s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Lock "cinder-quobyte-fd29e026-5e46-46c8-ab23-a97e1ba900c7" released by "delete_volume" :: held 0.786s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:38 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Created reservations ['5099bcfb-de2e-41b3-82cb-87ec50dc706f', 'af4a0560-fe1a-4798-899e-f8d2883ef36a', '5e087ae3-94f5-4cad-9d68-9ce7861ad119', '0340ae65-5944-484a-8bfa-937395152016'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:39 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:30:39 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Acquiring lock "cinder-d0175136-6c63-4694-a19c-c0c24d8bc064-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Lock "cinder-d0175136-6c63-4694-a19c-c0c24d8bc064-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Acquiring lock "cinder-quobyte-d0175136-6c63-4694-a19c-c0c24d8bc064" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Lock "cinder-quobyte-d0175136-6c63-4694-a19c-c0c24d8bc064" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[79af9834-5859-4133-99e5-cd5368142bfb]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:39 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.396s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:30:39 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Deleted volume successfully. Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d0ff6361-f3ad-43b4-8ab6-5475df5068e5 tempest-VolumesTestJSON-409668279 None] Lock "cinder-fd29e026-5e46-46c8-ab23-a97e1ba900c7-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:39 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064 Jul 17 15:30:39 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:39 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064" returned: 0 in 0.465s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:39 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064 Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-cb192847-bfcb-4248-9e6d-869e16973341 req-bc026f95-507f-4f12-a2f3-399e6f087449 tempest-AttachVolumeShelveTestJSON-311453147 None] No connector for attachment 69b4870f-55e7-498f-a017-5c2bdd2d718c; skipping storage backend terminate_connection call. {{(pid=87769) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 17 15:30:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-cb192847-bfcb-4248-9e6d-869e16973341 req-bc026f95-507f-4f12-a2f3-399e6f087449 tempest-AttachVolumeShelveTestJSON-311453147 None] Deleting attachment 69b4870f-55e7-498f-a017-5c2bdd2d718c. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:30:39 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:40 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d0175136-6c63-4694-a19c-c0c24d8bc064" returned: 0 in 0.279s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Lock "cinder-quobyte-d0175136-6c63-4694-a19c-c0c24d8bc064" released by "delete_volume" :: held 0.820s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Created reservations ['84a2c427-8fe0-4ad6-b37d-b005308100c3', '0ad1f927-f729-4a71-b24a-eec44604d0a6', 'ef8ddd69-6034-4510-b8ba-81f40108ade6', 'f563030d-043d-4cae-a16e-cbfdc3e3ed02'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:40 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:30:40 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:40 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.354s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:30:40 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Deleted volume successfully. Jul 17 15:30:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fafa924-95bf-47a0-b27f-0a80cc3fb14f tempest-VolumesTestJSON-409668279 None] Lock "cinder-d0175136-6c63-4694-a19c-c0c24d8bc064-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-47b4afd8-8f98-4446-b4b6-c8cca661fd52 tempest-GroupSnapshotsV319Test-1564777220 None] Group tempest-GroupSnapshotsV319Test-Group-1097887289: creating Jul 17 15:30:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-47b4afd8-8f98-4446-b4b6-c8cca661fd52 tempest-GroupSnapshotsV319Test-1564777220 None] Group tempest-GroupSnapshotsV319Test-Group-1097887289: created successfully Jul 17 15:30:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-47b4afd8-8f98-4446-b4b6-c8cca661fd52 tempest-GroupSnapshotsV319Test-1564777220 None] Create group completed successfully. Jul 17 15:30:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:30:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Flow 'volume_create_manager' (ba6bb869-f9ce-4f88-84bb-c4cd5d73249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e24dd9-19ae-4646-84e5-58996111edbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e24dd9-19ae-4646-84e5-58996111edbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986521463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=067f834a-eff0-43a0-9c59-c14a2f38e3fc,host='devstack@QuobyteHD#QuobyteHD',id=7fdcf8b3-319d-45f9-8392-0e0f7099af30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518907b992a24f41b26dcb1bcfaa09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:51Z,use_quota=True,user_id='cb7bb55c90db46febe4034bc6d0964f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6e5089a-62a3-49cd-b1da-e8c26ad5da39),volume_type_id=c6e5089a-62a3-49cd-b1da-e8c26ad5da39)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde73d01-77e3-4c95-aeee-b58de9a4e3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde73d01-77e3-4c95-aeee-b58de9a4e3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f25f775-9ba2-4458-b6a5-921bac990959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f25f775-9ba2-4458-b6a5-921bac990959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fdcf8b3-319d-45f9-8392-0e0f7099af30', 'volume_name': 'volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14417e5b-2211-44e4-b322-04d47782862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14417e5b-2211-44e4-b322-04d47782862b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afad6662-9084-4549-91ec-4e37bc999af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Volume 7fdcf8b3-319d-45f9-8392-0e0f7099af30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30', 'volume_size': 1} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=067f834a-eff0-43a0-9c59-c14a2f38e3fc,created_at=2026-07-17T13:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986521463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=067f834a-eff0-43a0-9c59-c14a2f38e3fc,host='devstack@QuobyteHD#QuobyteHD',id=7fdcf8b3-319d-45f9-8392-0e0f7099af30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518907b992a24f41b26dcb1bcfaa09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:30:51Z,use_quota=True,user_id='cb7bb55c90db46febe4034bc6d0964f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6e5089a-62a3-49cd-b1da-e8c26ad5da39),volume_type_id=c6e5089a-62a3-49cd-b1da-e8c26ad5da39)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Creating volume 7fdcf8b3-319d-45f9-8392-0e0f7099af30 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:30:51 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:51 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 1073741824 Jul 17 15:30:51 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:51 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 1073741824" returned: 0 in 0.778s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:52 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 Jul 17 15:30:52 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-36393252-b9c0-4a88-bc42-ee49484750ef tempest-GroupsV320Test-476217927 None] Group tempest-GroupsV320Test-Group-384546428: creating Jul 17 15:30:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-36393252-b9c0-4a88-bc42-ee49484750ef tempest-GroupsV320Test-476217927 None] Group tempest-GroupsV320Test-Group-384546428: created successfully Jul 17 15:30:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-36393252-b9c0-4a88-bc42-ee49484750ef tempest-GroupsV320Test-476217927 None] Create group completed successfully. Jul 17 15:30:52 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30" returned: 0 in 0.442s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:30:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afad6662-9084-4549-91ec-4e37bc999af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89849e1-2520-489c-8dd8-668f93b49a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:30:52 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Volume volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 (7fdcf8b3-319d-45f9-8392-0e0f7099af30): created successfully Jul 17 15:30:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89849e1-2520-489c-8dd8-668f93b49a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:30:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Flow 'volume_create_manager' (ba6bb869-f9ce-4f88-84bb-c4cd5d73249d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:30:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0d4ffc86-34a8-4a7e-b43a-ddae566a43fb tempest-GroupSnapshotsV319Test-1564777220 None] Created volume successfully. Jul 17 15:30:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] GroupSnapshot 6f5a2833-192f-44d1-b95b-3b33d1bf7f36: creating. Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] Created reservations ['f5aee91f-c329-4b52-aca9-7bc7670ebc69'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Group snapshot 6f5a2833-192f-44d1-b95b-3b33d1bf7f36: creating. {{(pid=87769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Creating offline snapshot d24274f2-5a8b-4c79-bce1-2de9814afe02 of volume 7fdcf8b3-319d-45f9-8392-0e0f7099af30 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[58555ee5-669c-4c5c-b98f-131b8e68c4a9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:30:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:53 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:30:53 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:54 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 Jul 17 15:30:54 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:54 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.260s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:54 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:30:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9127555b-f642-4c87-a6f3-787bb1edd5e4 tempest-GroupsV320Test-476217927 None] Delete group completed successfully. Jul 17 15:30:54 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30" returned: 0 in 0.389s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:54 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 1G Jul 17 15:30:54 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:54 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 1G" returned: 0 in 0.402s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:54 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 Jul 17 15:30:54 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:55 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02" returned: 0 in 0.361s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:55 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:30:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:55 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 Jul 17 15:30:55 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:55 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02" returned: 0 in 0.273s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:55 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.info Jul 17 15:30:55 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:55 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.info" returned: 0 in 0.266s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:55 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:30:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:55 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.info Jul 17 15:30:55 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:55 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.info" returned: 0 in 0.276s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:30:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fba37b99-e1a3-406f-8e36-927a68ac6c66 tempest-GroupSnapshotsV319Test-1564777220 None] group_snapshot 6f5a2833-192f-44d1-b95b-3b33d1bf7f36: created successfully Jul 17 15:30:57 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] group_snapshot 6f5a2833-192f-44d1-b95b-3b33d1bf7f36: deleting Jul 17 15:30:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] group_snapshot 6f5a2833-192f-44d1-b95b-3b33d1bf7f36: deleting {{(pid=87769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 15:30:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Acquiring lock "cinder-quobyte-7fdcf8b3-319d-45f9-8392-0e0f7099af30" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "cinder-quobyte-7fdcf8b3-319d-45f9-8392-0e0f7099af30" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Acquiring lock "cinder-quobyte-d24274f2-5a8b-4c79-bce1-2de9814afe02" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:30:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "cinder-quobyte-d24274f2-5a8b-4c79-bce1-2de9814afe02" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:30:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Deleting offline snapshot d24274f2-5a8b-4c79-bce1-2de9814afe02 of volume 7fdcf8b3-319d-45f9-8392-0e0f7099af30 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:30:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] snapshot_file for this snap is: volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:30:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0510e24-6232-426e-8c80-29c1faf52111]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:30:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:57 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 Jul 17 15:30:57 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:58 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02" returned: 0 in 0.402s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:30:58 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef119fa-2af5-4c08-b0f2-89df5423f6a9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:30:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:58 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 Jul 17 15:30:58 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:58 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30" returned: 0 in 0.378s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:58 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 Jul 17 15:30:58 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:58 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02" returned: 0 in 0.388s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:30:58 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02 Jul 17 15:30:58 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:30:59 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Jul 17 15:30:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30.d24274f2-5a8b-4c79-bce1-2de9814afe02" returned: 0 in 0.307s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:30:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "cinder-quobyte-d24274f2-5a8b-4c79-bce1-2de9814afe02" released by "_delete_snapshot" :: held 1.575s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "cinder-quobyte-7fdcf8b3-319d-45f9-8392-0e0f7099af30" released by "delete_snapshot" :: held 1.608s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:30:59 devstack cinder-volume[87769]: WARNING cinder.quota [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-716103867 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-716103867, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:30:59 devstack cinder-volume[87769]: WARNING cinder.quota [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-716103867 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-716103867, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:30:59 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] Created reservations ['28868e98-0fc1-4def-9b8b-0a6f0be6cab2', 'e34ce711-fbd3-4cd6-ab61-21fa07eb7340', '80385c79-b144-4e58-bc0e-abdce2068321', '09aab9bd-8817-4be6-966d-e70ad4235a15'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:30:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-700dd0e0-44cb-4d8e-bb83-8f0d89dcc284 tempest-GroupSnapshotsV319Test-1564777220 None] group_snapshot 6f5a2833-192f-44d1-b95b-3b33d1bf7f36: deleted successfully Jul 17 15:31:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Acquiring lock "cinder-quobyte-7fdcf8b3-319d-45f9-8392-0e0f7099af30" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "cinder-quobyte-7fdcf8b3-319d-45f9-8392-0e0f7099af30" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ea913e-6058-4c5d-88ee-19b7f4111ba8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:00 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 Jul 17 15:31:00 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:00 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30" returned: 0 in 0.515s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:00 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30 Jul 17 15:31:00 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:01 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7fdcf8b3-319d-45f9-8392-0e0f7099af30" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "cinder-quobyte-7fdcf8b3-319d-45f9-8392-0e0f7099af30" released by "delete_volume" :: held 0.858s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Created reservations ['d4b51a73-a6e6-49d4-9960-6ea84b15d3d2'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:01 devstack cinder-volume[87769]: WARNING cinder.quota [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-716103867 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-716103867, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Created reservations ['9558bb3f-ca2d-43ce-b2c0-1038c0967a39', 'a68b6bbb-882f-453c-ab7f-ab73cc6a8f5f', 'adf1916a-960f-4269-a2ca-78d4676de80d', 'ddadedd6-cc50-4280-8018-f0e24f39cdd9'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:01 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:01 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:01 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.362s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:01 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:01 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-458100a7-b430-4f40-8c55-0ef6dd246297 tempest-GroupSnapshotsV319Test-1564777220 None] Delete group completed successfully. Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Flow 'volume_create_manager' (bef5480e-7a3e-4e01-8bb6-8fd53ce781a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0c7fe8-8e1c-46a5-860f-ebde68e6c5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0c7fe8-8e1c-46a5-860f-ebde68e6c5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-64469776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4c1214-2d8f-4797-9a62-1753ffefa151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9cd1aa526c647bbb6a0505eb6f13b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:08Z,use_quota=True,user_id='4c87f5112c7f4a8b8b79cdb1d805e097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f6ff66b-3332-41d6-96e7-c05693029e5d),volume_type_id=0f6ff66b-3332-41d6-96e7-c05693029e5d)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b2a6e4-c5ee-4951-8402-93aa578b905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b2a6e4-c5ee-4951-8402-93aa578b905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cff9999-661e-4125-9938-6de728ed58b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cff9999-661e-4125-9938-6de728ed58b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4c1214-2d8f-4797-9a62-1753ffefa151', 'volume_name': 'volume-1f4c1214-2d8f-4797-9a62-1753ffefa151', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70db327e-9d81-4efe-8c18-e6868e2447ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70db327e-9d81-4efe-8c18-e6868e2447ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a680fc-7f74-43e9-906c-73aec37e0958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:08 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Volume 1f4c1214-2d8f-4797-9a62-1753ffefa151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4c1214-2d8f-4797-9a62-1753ffefa151', 'volume_size': 1} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-64469776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4c1214-2d8f-4797-9a62-1753ffefa151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9cd1aa526c647bbb6a0505eb6f13b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:08Z,use_quota=True,user_id='4c87f5112c7f4a8b8b79cdb1d805e097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f6ff66b-3332-41d6-96e7-c05693029e5d),volume_type_id=0f6ff66b-3332-41d6-96e7-c05693029e5d)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Creating volume 1f4c1214-2d8f-4797-9a62-1753ffefa151 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:08 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:08 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 1073741824 Jul 17 15:31:08 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:08 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 1073741824" returned: 0 in 0.402s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:08 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 Jul 17 15:31:08 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:08 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151" returned: 0 in 0.254s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a680fc-7f74-43e9-906c-73aec37e0958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4c1214-2d8f-4797-9a62-1753ffefa151', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d0d3b6-183b-42a2-8d79-d28d6adfda47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:09 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Volume volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 (1f4c1214-2d8f-4797-9a62-1753ffefa151): created successfully Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d0d3b6-183b-42a2-8d79-d28d6adfda47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Flow 'volume_create_manager' (bef5480e-7a3e-4e01-8bb6-8fd53ce781a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4f2822e5-ab8b-4743-b1b8-09009289ce53 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Created volume successfully. Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99958a00-6bc8-4bea-b522-57197690444e tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99958a00-6bc8-4bea-b522-57197690444e tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99958a00-6bc8-4bea-b522-57197690444e tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99958a00-6bc8-4bea-b522-57197690444e tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99958a00-6bc8-4bea-b522-57197690444e tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99958a00-6bc8-4bea-b522-57197690444e tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:09 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:09 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:09 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99958a00-6bc8-4bea-b522-57197690444e tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.258s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:09 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-99958a00-6bc8-4bea-b522-57197690444e tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-99958a00-6bc8-4bea-b522-57197690444e tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Retype volume completed successfully. Jul 17 15:31:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Acquiring lock "cinder-1f4c1214-2d8f-4797-9a62-1753ffefa151-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "cinder-1f4c1214-2d8f-4797-9a62-1753ffefa151-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Acquiring lock "cinder-quobyte-1f4c1214-2d8f-4797-9a62-1753ffefa151" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "cinder-quobyte-1f4c1214-2d8f-4797-9a62-1753ffefa151" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[483a3484-9338-4c49-95cd-70abe962e357]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:11 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 Jul 17 15:31:11 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:11 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151" returned: 0 in 0.402s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:11 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151 Jul 17 15:31:11 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:11 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1f4c1214-2d8f-4797-9a62-1753ffefa151" returned: 0 in 0.268s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "cinder-quobyte-1f4c1214-2d8f-4797-9a62-1753ffefa151" released by "delete_volume" :: held 0.732s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:11 devstack cinder-volume[87769]: WARNING cinder.quota [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:31:11 devstack cinder-volume[87769]: WARNING cinder.quota [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Created reservations ['c3cf64ae-87aa-464a-922d-6adaf0b852c2', '61c4d100-c7cf-4cd3-a579-c19d010cd77e', 'bf81f98d-e709-42f4-8687-d2e78b0ee515', '7730616b-dc16-4791-88c0-610eec036b19'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:11 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:11 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:12 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.302s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:12 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:12 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Deleted volume successfully. Jul 17 15:31:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8bb7e10-5e87-444a-b4e1-8e8e28e5baa6 tempest-VolumeRetypeWithoutMigrationTest-1635391619 None] Lock "cinder-1f4c1214-2d8f-4797-9a62-1753ffefa151-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Acquiring lock "cinder-daff0d63-1874-41dc-a83f-e0da3df30cfc-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "cinder-daff0d63-1874-41dc-a83f-e0da3df30cfc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Acquiring lock "cinder-quobyte-daff0d63-1874-41dc-a83f-e0da3df30cfc" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "cinder-quobyte-daff0d63-1874-41dc-a83f-e0da3df30cfc" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3b94bf-aa6e-495d-84f1-453d01bb9e2e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:18 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc Jul 17 15:31:18 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:18 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc" returned: 0 in 0.402s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:18 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc Jul 17 15:31:18 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:18 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-daff0d63-1874-41dc-a83f-e0da3df30cfc" returned: 0 in 0.285s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "cinder-quobyte-daff0d63-1874-41dc-a83f-e0da3df30cfc" released by "delete_volume" :: held 0.743s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:18 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Created reservations ['fb410a0b-41fa-4b74-9f03-b0ce5335b332', '81c120bb-86cc-49fb-8ffb-a4a875225be8', '4870e44e-d8b6-4f83-96e2-496db5f332c1', 'a27f6c02-b04c-489a-8ebd-b33d652c4e1c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:19 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:19 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:19 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.270s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:19 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Deleted volume successfully. Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3b99a8b8-69a6-4ee3-a846-11cc2ff28326 tempest-AttachVolumeShelveTestJSON-311453147 None] Lock "cinder-daff0d63-1874-41dc-a83f-e0da3df30cfc-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Flow 'volume_create_manager' (0698ed7f-c927-4c2b-a9e5-a29157b69d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c1966e-81e1-4788-9d8a-6b93164df2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c1966e-81e1-4788-9d8a-6b93164df2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2116729180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cefaf6bf-e6a2-4d04-9968-4de2a30413f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef62ad74eb20476fbf8cc98656a4676a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:20Z,use_quota=True,user_id='b9dddacb4b1a4193b0c0707f1b50a137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee28efde-648a-4b14-9075-1adb728f2e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee28efde-648a-4b14-9075-1adb728f2e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258510e7-44e3-4370-babf-42c1692db280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258510e7-44e3-4370-babf-42c1692db280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cefaf6bf-e6a2-4d04-9968-4de2a30413f5', 'volume_name': 'volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a371940-23dd-4dfe-95ef-1f23c3c90258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a371940-23dd-4dfe-95ef-1f23c3c90258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e63c7fb-5fc2-41a8-b06d-dddf5a3f2c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Volume cefaf6bf-e6a2-4d04-9968-4de2a30413f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5', 'volume_size': 1} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2116729180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cefaf6bf-e6a2-4d04-9968-4de2a30413f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef62ad74eb20476fbf8cc98656a4676a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:20Z,use_quota=True,user_id='b9dddacb4b1a4193b0c0707f1b50a137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Creating volume cefaf6bf-e6a2-4d04-9968-4de2a30413f5 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:20 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:20 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 1073741824 Jul 17 15:31:20 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Flow 'volume_create_manager' (7c04edd6-20d5-4d4a-88c3-dc1eb46925fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dc666b-1f5d-479f-8145-b50335ab1479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dc666b-1f5d-479f-8145-b50335ab1479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-435549743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917bb877-3656-4e81-9290-428f914991d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366472787b334010aea12b46c74047e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:20Z,use_quota=True,user_id='cb3627a151804793a2ab1543ffe959b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(599182ba-4597-4c6d-b828-f03693db5995),volume_type_id=599182ba-4597-4c6d-b828-f03693db5995)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0794710d-691f-4bed-8970-552687311c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0794710d-691f-4bed-8970-552687311c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f12364-6297-4c8b-a8c3-e9afcb68a39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f12364-6297-4c8b-a8c3-e9afcb68a39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917bb877-3656-4e81-9290-428f914991d4', 'volume_name': 'volume-917bb877-3656-4e81-9290-428f914991d4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483fb592-2c54-46a8-919c-e43083b47938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483fb592-2c54-46a8-919c-e43083b47938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129364c5-5172-4ef6-9461-2b8250f4b52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Volume 917bb877-3656-4e81-9290-428f914991d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917bb877-3656-4e81-9290-428f914991d4', 'volume_size': 1} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:20 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 1073741824" returned: 0 in 0.548s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:20 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 Jul 17 15:31:20 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:20 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-435549743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917bb877-3656-4e81-9290-428f914991d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366472787b334010aea12b46c74047e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:20Z,use_quota=True,user_id='cb3627a151804793a2ab1543ffe959b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(599182ba-4597-4c6d-b828-f03693db5995),volume_type_id=599182ba-4597-4c6d-b828-f03693db5995)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Creating volume 917bb877-3656-4e81-9290-428f914991d4 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:20 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e63c7fb-5fc2-41a8-b06d-dddf5a3f2c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfbd757-2358-415e-ad94-db12a3e00312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:20 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4 1073741824 Jul 17 15:31:20 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Volume volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 (cefaf6bf-e6a2-4d04-9968-4de2a30413f5): created successfully Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfbd757-2358-415e-ad94-db12a3e00312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Flow 'volume_create_manager' (0698ed7f-c927-4c2b-a9e5-a29157b69d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:20 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c3025153-51a2-4fe8-9a5a-afcb3d017069 tempest-VolumeQuotasAdminTestJSON-2146060760 None] Created volume successfully. Jul 17 15:31:21 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4 1073741824" returned: 0 in 0.502s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:21 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4 Jul 17 15:31:21 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:21 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4" returned: 0 in 0.250s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129364c5-5172-4ef6-9461-2b8250f4b52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917bb877-3656-4e81-9290-428f914991d4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeed5c1a-0ff2-4b35-8f31-85d98808aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Volume volume-917bb877-3656-4e81-9290-428f914991d4 (917bb877-3656-4e81-9290-428f914991d4): created successfully Jul 17 15:31:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeed5c1a-0ff2-4b35-8f31-85d98808aeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Flow 'volume_create_manager' (7c04edd6-20d5-4d4a-88c3-dc1eb46925fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2c56711e-f0dd-436b-a50a-9697a8d6b74c tempest-VolumeTypesAccessTest-1456010849 None] Created volume successfully. Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Acquiring lock "cinder-cefaf6bf-e6a2-4d04-9968-4de2a30413f5-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "cinder-cefaf6bf-e6a2-4d04-9968-4de2a30413f5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Acquiring lock "cinder-quobyte-cefaf6bf-e6a2-4d04-9968-4de2a30413f5" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "cinder-quobyte-cefaf6bf-e6a2-4d04-9968-4de2a30413f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[72958558-fc01-426b-827e-9171d4eea69c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:22 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 Jul 17 15:31:22 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:22 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5" returned: 0 in 0.394s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Acquiring lock "cinder-917bb877-3656-4e81-9290-428f914991d4-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:22 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5 Jul 17 15:31:22 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Lock "cinder-917bb877-3656-4e81-9290-428f914991d4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Acquiring lock "cinder-quobyte-917bb877-3656-4e81-9290-428f914991d4" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Lock "cinder-quobyte-917bb877-3656-4e81-9290-428f914991d4" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f2ec83-fd40-4ac2-93ea-411135b4c977]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:22 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:22 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:22 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4 Jul 17 15:31:22 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:22 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-cefaf6bf-e6a2-4d04-9968-4de2a30413f5" returned: 0 in 0.333s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "cinder-quobyte-cefaf6bf-e6a2-4d04-9968-4de2a30413f5" released by "delete_volume" :: held 0.787s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:22 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Created reservations ['93fad063-66ab-4386-b558-b5eb7f387222', '14f92187-9b76-4fbf-9d16-42a5eb64eef5', 'd347f3a1-b7e5-4fb0-a9f1-429247a2f5fa', '33f75198-fe00-4ae7-b0a5-42723722ec5b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:23 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:23 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:23 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.385s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 8 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:31:23 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4" returned: 0 in 0.574s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:23 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4 Jul 17 15:31:23 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:23 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.427s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Deleted volume successfully. Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3c3c57fd-13e0-4426-afe9-31a441b1aacb tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "cinder-cefaf6bf-e6a2-4d04-9968-4de2a30413f5-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:23 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-917bb877-3656-4e81-9290-428f914991d4" returned: 0 in 0.298s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Lock "cinder-quobyte-917bb877-3656-4e81-9290-428f914991d4" released by "delete_volume" :: held 0.918s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:23 devstack cinder-volume[87769]: WARNING cinder.quota [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-295905 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-295905, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:31:23 devstack cinder-volume[87769]: WARNING cinder.quota [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-295905 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-295905, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Created reservations ['b0db4840-c913-45a5-b59e-cd59066d9d36', 'b74fe3fb-ac26-4ee7-83a1-91506f6443fc', '84813530-d4ce-492e-bad7-a1312abd88a6', 'c8c4ec26-fda4-4926-b61e-8ddf1714a32e'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:23 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:23 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Flow 'volume_create_manager' (ff1a058a-628f-407f-9f10-0f0e7bae7ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5eb02e-fd78-4c99-ab29-0c1fe7cf37b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5eb02e-fd78-4c99-ab29-0c1fe7cf37b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1451354054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d253f8a-d64b-4bf7-86f4-c5bea03ec945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef62ad74eb20476fbf8cc98656a4676a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:24Z,use_quota=True,user_id='b9dddacb4b1a4193b0c0707f1b50a137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81dd2914-3c10-4b87-8515-81b700e5277c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81dd2914-3c10-4b87-8515-81b700e5277c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e042fcbf-3547-4016-b4ce-37dd14abc806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e042fcbf-3547-4016-b4ce-37dd14abc806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d253f8a-d64b-4bf7-86f4-c5bea03ec945', 'volume_name': 'volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c7046b-792c-46ec-8272-159b9e5363ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c7046b-792c-46ec-8272-159b9e5363ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a373ea-5271-4968-afdd-8c7bcb0ed1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:24 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Volume 3d253f8a-d64b-4bf7-86f4-c5bea03ec945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945', 'volume_size': 1} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1451354054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d253f8a-d64b-4bf7-86f4-c5bea03ec945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef62ad74eb20476fbf8cc98656a4676a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:24Z,use_quota=True,user_id='b9dddacb4b1a4193b0c0707f1b50a137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Creating volume 3d253f8a-d64b-4bf7-86f4-c5bea03ec945 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:24 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:24 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 1073741824 Jul 17 15:31:24 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:24 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.454s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Deleted volume successfully. Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a28c375b-0bbb-4ca2-8aec-3b2b0d420084 tempest-VolumeTypesAccessTest-1456010849 None] Lock "cinder-917bb877-3656-4e81-9290-428f914991d4-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:24 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 1073741824" returned: 0 in 0.562s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:24 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 Jul 17 15:31:24 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:24 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a373ea-5271-4968-afdd-8c7bcb0ed1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57ecfd2-7129-471f-a22d-5ed197dc44cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:25 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Volume volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 (3d253f8a-d64b-4bf7-86f4-c5bea03ec945): created successfully Jul 17 15:31:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57ecfd2-7129-471f-a22d-5ed197dc44cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Flow 'volume_create_manager' (ff1a058a-628f-407f-9f10-0f0e7bae7ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7b5ff96d-a847-4eb1-88de-4d6ef6f77c8f tempest-VolumeQuotasAdminTestJSON-2146060760 None] Created volume successfully. Jul 17 15:31:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=96,cinder:UPDATE=116,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:31:26 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d43559d0-2cd8-4d66-8a40-387c7235d07f tempest-VolumeQuotasAdminTestJSON-829076880 None] Transfer volume completed successfully. Jul 17 15:31:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Acquiring lock "cinder-3d253f8a-d64b-4bf7-86f4-c5bea03ec945-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Lock "cinder-3d253f8a-d64b-4bf7-86f4-c5bea03ec945-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:27 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=122,cinder:SELECT=98,cinder:DELETE=11,cinder:INSERT=25 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:31:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Acquiring lock "cinder-quobyte-3d253f8a-d64b-4bf7-86f4-c5bea03ec945" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Lock "cinder-quobyte-3d253f8a-d64b-4bf7-86f4-c5bea03ec945" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:27 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc31a7c-6ac7-4eba-baf2-fd3413f138c1]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:27 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 Jul 17 15:31:27 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:28 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945" returned: 0 in 0.460s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:28 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945 Jul 17 15:31:28 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:28 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d253f8a-d64b-4bf7-86f4-c5bea03ec945" returned: 0 in 0.278s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Lock "cinder-quobyte-3d253f8a-d64b-4bf7-86f4-c5bea03ec945" released by "delete_volume" :: held 0.788s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Created reservations ['75d6d432-59af-4d9f-8656-d21433e47092', '2dd47b0e-3bd3-4c69-8a07-ad43026472da', 'b9317217-28c1-4e6a-9636-ebff091352bc', 'c3046446-6bea-4799-a67d-ca6b672a5f41'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:28 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:28 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:28 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.357s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:28 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:28 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Deleted volume successfully. Jul 17 15:31:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d964842-8cab-4c27-ab6a-3a301e7564d5 tempest-VolumeQuotasAdminTestJSON-1658326757 None] Lock "cinder-3d253f8a-d64b-4bf7-86f4-c5bea03ec945-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Flow 'volume_create_manager' (731be44b-4bd6-4f6c-9ab2-da3a1f390a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b41b0eb-32a1-4f97-aa21-4eac2419fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b41b0eb-32a1-4f97-aa21-4eac2419fe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1577384984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5b6404-e2d3-46d1-9a83-dbadae0d2295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862d16f206b54eb3a2cb4c64cfeb0cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:39Z,use_quota=True,user_id='e9be823b573b41a98cd7818511a0ed85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d2174e-d075-4c70-b31a-9560917f2a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d2174e-d075-4c70-b31a-9560917f2a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8467f33-610e-4baa-b49d-886edf707055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8467f33-610e-4baa-b49d-886edf707055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5b6404-e2d3-46d1-9a83-dbadae0d2295', 'volume_name': 'volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c059f4-a94a-437a-aec1-2fe5bf4d59c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c059f4-a94a-437a-aec1-2fe5bf4d59c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cd44c4-271c-4287-afed-faa3deec0011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:38 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Volume aa5b6404-e2d3-46d1-9a83-dbadae0d2295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295', 'volume_size': 1} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1577384984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5b6404-e2d3-46d1-9a83-dbadae0d2295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862d16f206b54eb3a2cb4c64cfeb0cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:39Z,use_quota=True,user_id='e9be823b573b41a98cd7818511a0ed85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Creating volume aa5b6404-e2d3-46d1-9a83-dbadae0d2295 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:38 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:38 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 1073741824 Jul 17 15:31:38 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:38 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Flow 'volume_create_manager' (c1c9915c-fb23-4998-a686-50e18adb1ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851fa047-2c07-4fe5-a84a-89d9f6bdf7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851fa047-2c07-4fe5-a84a-89d9f6bdf7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1414015267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3350736af4db095a7ecfcee84db49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:39Z,use_quota=True,user_id='3115ff66df6240f2ac6d5daf11bbdca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b03552-195d-4836-a598-aa7af6351831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b03552-195d-4836-a598-aa7af6351831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e82b19-27dc-4e77-8c50-5927c3563ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e82b19-27dc-4e77-8c50-5927c3563ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa', 'volume_name': 'volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2dad9c-6783-427c-9eb6-25fbfaf3bcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2dad9c-6783-427c-9eb6-25fbfaf3bcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3bb599-f4c5-41de-80f1-8f218976aaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:39 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Volume 3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa', 'volume_size': 1} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:39 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 1073741824" returned: 0 in 0.474s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:39 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 Jul 17 15:31:39 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:39 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295" returned: 0 in 0.283s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1414015267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3350736af4db095a7ecfcee84db49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:39Z,use_quota=True,user_id='3115ff66df6240f2ac6d5daf11bbdca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Creating volume 3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:39 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:39 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa 1073741824 Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cd44c4-271c-4287-afed-faa3deec0011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:39 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6f68a8-d33d-4b66-9aed-d59f13d3d802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:39 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Volume volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 (aa5b6404-e2d3-46d1-9a83-dbadae0d2295): created successfully Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6f68a8-d33d-4b66-9aed-d59f13d3d802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Flow 'volume_create_manager' (731be44b-4bd6-4f6c-9ab2-da3a1f390a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:39 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-3409db94-d3ef-434d-8226-5566fb2b9e66 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Created volume successfully. Jul 17 15:31:40 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa 1073741824" returned: 0 in 0.489s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:40 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa Jul 17 15:31:40 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:40 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3bb599-f4c5-41de-80f1-8f218976aaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2232f93b-52ef-423e-9974-b48ba8db4e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:40 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Volume volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa (3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa): created successfully Jul 17 15:31:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2232f93b-52ef-423e-9974-b48ba8db4e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Flow 'volume_create_manager' (c1c9915c-fb23-4998-a686-50e18adb1ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:40 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f6c3c132-c707-479a-9b77-b5e7295b0c6d tempest-VolumesListAdminTestJSON-1930415947 None] Created volume successfully. Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Flow 'volume_create_manager' (44eab065-cadc-4451-a576-52f61ad4e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7967a32a-266a-40da-9bed-1b056a3020d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7967a32a-266a-40da-9bed-1b056a3020d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-233527693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18192bbb-bd81-424e-b4f4-30ee6eb7c8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3350736af4db095a7ecfcee84db49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:42Z,use_quota=True,user_id='3115ff66df6240f2ac6d5daf11bbdca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7414ac80-1b38-4ab9-ba5f-250ee4f004e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7414ac80-1b38-4ab9-ba5f-250ee4f004e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f224072e-5b29-4b20-acde-cfa9ac328027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f224072e-5b29-4b20-acde-cfa9ac328027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18192bbb-bd81-424e-b4f4-30ee6eb7c8bc', 'volume_name': 'volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d8cd84-dfd8-4f0f-9b9a-c246687f951b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d8cd84-dfd8-4f0f-9b9a-c246687f951b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6cfc65-0f0d-410b-9e93-ea7ba62a370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:41 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Volume 18192bbb-bd81-424e-b4f4-30ee6eb7c8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc', 'volume_size': 1} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-233527693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18192bbb-bd81-424e-b4f4-30ee6eb7c8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3350736af4db095a7ecfcee84db49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:42Z,use_quota=True,user_id='3115ff66df6240f2ac6d5daf11bbdca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Creating volume 18192bbb-bd81-424e-b4f4-30ee6eb7c8bc {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:41 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:41 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc 1073741824 Jul 17 15:31:41 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Acquiring lock "cinder-aa5b6404-e2d3-46d1-9a83-dbadae0d2295-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "cinder-aa5b6404-e2d3-46d1-9a83-dbadae0d2295-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Acquiring lock "cinder-quobyte-aa5b6404-e2d3-46d1-9a83-dbadae0d2295" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "cinder-quobyte-aa5b6404-e2d3-46d1-9a83-dbadae0d2295" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3b5bda-a013-4f0b-ac73-77f87bd99d4b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:42 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 Jul 17 15:31:42 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:42 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:42 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295" returned: 0 in 0.394s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc 1073741824" returned: 0 in 0.552s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:42 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295 Jul 17 15:31:42 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:42 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc Jul 17 15:31:42 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:42 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa5b6404-e2d3-46d1-9a83-dbadae0d2295" returned: 0 in 0.266s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "cinder-quobyte-aa5b6404-e2d3-46d1-9a83-dbadae0d2295" released by "delete_volume" :: held 0.705s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Created reservations ['ebd8407e-2b6d-4c95-bd38-05e0bae3cae8', '05431e70-54f3-4b54-b4cf-2da49e50ea11', 'b4d7b1c5-2543-4910-bd41-6d054e6702a2', '5b5e1b6b-103e-4245-bab5-993de975d910'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:42 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc" returned: 0 in 0.294s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6cfc65-0f0d-410b-9e93-ea7ba62a370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b919f501-6ce3-4778-ac1d-408016d49ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:42 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Volume volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc (18192bbb-bd81-424e-b4f4-30ee6eb7c8bc): created successfully Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b919f501-6ce3-4778-ac1d-408016d49ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Flow 'volume_create_manager' (44eab065-cadc-4451-a576-52f61ad4e555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ceae32ed-22ff-4c2f-8db2-b70f8cbd5ade tempest-VolumesListAdminTestJSON-1930415947 None] Created volume successfully. Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:42 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:42 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:43 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.308s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:43 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:43 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Deleted volume successfully. Jul 17 15:31:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-66e9a2f5-a1cc-41dd-aef7-8bfd14d5edc5 tempest-VolumeQuotasNegativeTestJSON-1970951682 None] Lock "cinder-aa5b6404-e2d3-46d1-9a83-dbadae0d2295-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Flow 'volume_create_manager' (e1a5ad96-6c60-48f0-9f94-65c15361a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5adc318-9f09-4d8d-9557-1d05466d8336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5adc318-9f09-4d8d-9557-1d05466d8336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1106815607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1668e209-6c60-4c78-b9a9-afb914175f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3350736af4db095a7ecfcee84db49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:44Z,use_quota=True,user_id='3115ff66df6240f2ac6d5daf11bbdca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38c65dc-ba65-4563-8749-7b12be821b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38c65dc-ba65-4563-8749-7b12be821b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d38198-4793-4143-805e-5d59609a3fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d38198-4793-4143-805e-5d59609a3fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1668e209-6c60-4c78-b9a9-afb914175f34', 'volume_name': 'volume-1668e209-6c60-4c78-b9a9-afb914175f34', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e305da0-5f79-4246-bda9-44e235dfb9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e305da0-5f79-4246-bda9-44e235dfb9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077ee79b-8ed1-4d34-97af-0dcef3afb6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:44 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Volume 1668e209-6c60-4c78-b9a9-afb914175f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1668e209-6c60-4c78-b9a9-afb914175f34', 'volume_size': 1} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1106815607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1668e209-6c60-4c78-b9a9-afb914175f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3350736af4db095a7ecfcee84db49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:44Z,use_quota=True,user_id='3115ff66df6240f2ac6d5daf11bbdca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Creating volume 1668e209-6c60-4c78-b9a9-afb914175f34 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:44 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:44 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34 1073741824 Jul 17 15:31:44 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:45 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34 1073741824" returned: 0 in 0.530s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:45 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34 Jul 17 15:31:45 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:45 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34" returned: 0 in 0.334s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077ee79b-8ed1-4d34-97af-0dcef3afb6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1668e209-6c60-4c78-b9a9-afb914175f34', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dddf620-ebd5-4ab3-ac20-3819cfdf3b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Volume volume-1668e209-6c60-4c78-b9a9-afb914175f34 (1668e209-6c60-4c78-b9a9-afb914175f34): created successfully Jul 17 15:31:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dddf620-ebd5-4ab3-ac20-3819cfdf3b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Flow 'volume_create_manager' (e1a5ad96-6c60-48f0-9f94-65c15361a913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-95774f4d-480d-4eed-b3ea-ccc225a2df23 tempest-VolumesListAdminTestJSON-1930415947 None] Created volume successfully. Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Flow 'volume_create_manager' (638e0e23-b683-405a-a7ed-a98e31021d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f184752e-e5e7-4380-8ec5-619d83d1c8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f184752e-e5e7-4380-8ec5-619d83d1c8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8a061d-9264-4587-917b-85eb3154e0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfb112d3bcb49ac9dfdca014e7b2a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:48Z,use_quota=True,user_id='41494cee989f42b7b9aa5b431e356ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc97c03f-e1ac-4988-91c7-8528e0a225bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc97c03f-e1ac-4988-91c7-8528e0a225bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba01f1b-016b-426b-a08c-ad8f0ca58408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba01f1b-016b-426b-a08c-ad8f0ca58408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a8a061d-9264-4587-917b-85eb3154e0d4', 'volume_name': 'volume-9a8a061d-9264-4587-917b-85eb3154e0d4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf7fcbf-e5a2-46cf-88c0-eba5f01d2289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf7fcbf-e5a2-46cf-88c0-eba5f01d2289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339e766c-db2b-45f3-82ab-e07e1af9240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:48 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Volume 9a8a061d-9264-4587-917b-85eb3154e0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a8a061d-9264-4587-917b-85eb3154e0d4', 'volume_size': 1} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8a061d-9264-4587-917b-85eb3154e0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfb112d3bcb49ac9dfdca014e7b2a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:48Z,use_quota=True,user_id='41494cee989f42b7b9aa5b431e356ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Creating volume 9a8a061d-9264-4587-917b-85eb3154e0d4 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:48 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:48 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4 1073741824 Jul 17 15:31:48 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:49 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4 1073741824" returned: 0 in 0.639s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:49 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4 Jul 17 15:31:49 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:49 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4" returned: 0 in 0.352s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339e766c-db2b-45f3-82ab-e07e1af9240c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8a061d-9264-4587-917b-85eb3154e0d4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a17604-6240-438d-b5ef-4ef8ddc8ed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:49 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Volume volume-9a8a061d-9264-4587-917b-85eb3154e0d4 (9a8a061d-9264-4587-917b-85eb3154e0d4): created successfully Jul 17 15:31:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a17604-6240-438d-b5ef-4ef8ddc8ed19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Flow 'volume_create_manager' (638e0e23-b683-405a-a7ed-a98e31021d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:49 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a8dbfac0-6212-4f34-8401-28d8be954145 tempest-VolumesListAdminTestJSON-102826555 None] Created volume successfully. Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Flow 'volume_create_manager' (166d6c84-6659-484f-b583-8ea451866404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66460bbf-ba17-4919-b663-782e67d89b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66460bbf-ba17-4919-b663-782e67d89b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1596579474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f16754b-cb75-4be0-8f5a-96fe8ad28993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2360c547eebe4a9d84a8a7f8bd250b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:50Z,use_quota=True,user_id='c15b78c4927948ea935d1e40c9ab454b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f615ba70-69e1-4f5d-bb29-8c19f5857dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f615ba70-69e1-4f5d-bb29-8c19f5857dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d916ac4-03b5-4d46-896f-3396994e8554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d916ac4-03b5-4d46-896f-3396994e8554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f16754b-cb75-4be0-8f5a-96fe8ad28993', 'volume_name': 'volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86662bb6-45dc-4e09-ac4c-dc172b9c80fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86662bb6-45dc-4e09-ac4c-dc172b9c80fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f855d1-d5ae-4754-9eba-20ab92b016a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Volume 0f16754b-cb75-4be0-8f5a-96fe8ad28993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993', 'volume_size': 1} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1596579474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f16754b-cb75-4be0-8f5a-96fe8ad28993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2360c547eebe4a9d84a8a7f8bd250b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:31:50Z,use_quota=True,user_id='c15b78c4927948ea935d1e40c9ab454b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Creating volume 0f16754b-cb75-4be0-8f5a-96fe8ad28993 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:31:50 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:50 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 1073741824 Jul 17 15:31:50 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Acquiring lock "cinder-9a8a061d-9264-4587-917b-85eb3154e0d4-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Lock "cinder-9a8a061d-9264-4587-917b-85eb3154e0d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Acquiring lock "cinder-quobyte-9a8a061d-9264-4587-917b-85eb3154e0d4" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Lock "cinder-quobyte-9a8a061d-9264-4587-917b-85eb3154e0d4" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e554e383-e99f-491c-b16c-3f43b5499e0c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "cinder-1668e209-6c60-4c78-b9a9-afb914175f34-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-1668e209-6c60-4c78-b9a9-afb914175f34-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "cinder-quobyte-1668e209-6c60-4c78-b9a9-afb914175f34" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:51 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4 Jul 17 15:31:51 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-quobyte-1668e209-6c60-4c78-b9a9-afb914175f34" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b415e1-fafe-4e52-a540-1fc806f85102]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:51 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 1073741824" returned: 0 in 0.659s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:51 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34 Jul 17 15:31:51 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:51 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 Jul 17 15:31:51 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:51 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4" returned: 0 in 0.574s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:51 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4 Jul 17 15:31:51 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:51 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34" returned: 0 in 0.446s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:51 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:51 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34 Jul 17 15:31:51 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f855d1-d5ae-4754-9eba-20ab92b016a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79921c71-0d7e-4852-ace3-62e8e5bd4fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:31:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Volume volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 (0f16754b-cb75-4be0-8f5a-96fe8ad28993): created successfully Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79921c71-0d7e-4852-ace3-62e8e5bd4fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:31:51 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Flow 'volume_create_manager' (166d6c84-6659-484f-b583-8ea451866404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9a8a061d-9264-4587-917b-85eb3154e0d4" returned: 0 in 0.329s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Lock "cinder-quobyte-9a8a061d-9264-4587-917b-85eb3154e0d4" released by "delete_volume" :: held 0.958s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:51 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-173b188c-a32a-4d24-8f5e-2320a37fb999 tempest-VolumesServicesTestJSON-1050939677 None] Created volume successfully. Jul 17 15:31:51 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Created reservations ['4256c826-ab37-481a-bef9-c55ba974351e', 'ba7c56a3-b1af-45fb-943e-0a5d772320ab', '3d6409c6-58f4-4ba5-8cd9-710ddc158e6b', '36a3530b-7f85-465f-92ac-b4acd1c5b097'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:52 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1668e209-6c60-4c78-b9a9-afb914175f34" returned: 0 in 0.370s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:52 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:52 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-quobyte-1668e209-6c60-4c78-b9a9-afb914175f34" released by "delete_volume" :: held 0.879s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Created reservations ['ddc77cca-81f5-4cd5-9365-bbb2859c4ff4', '4f78a0be-686e-4bd6-8496-3d11472935c1', 'e7af85bd-5952-479f-890a-abee17b83a8a', 'ab0fbd4b-aac8-417e-b56f-2cc70056a3eb'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:52 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:52 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:52 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.414s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Deleted volume successfully. Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "cinder-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:52 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ebd4d417-4704-44fd-b920-bb0c7310edbe tempest-VolumesListAdminTestJSON-102826555 None] Lock "cinder-9a8a061d-9264-4587-917b-85eb3154e0d4-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Deleted volume successfully. Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "cinder-quobyte-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-quobyte-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-26cafcf1-ee7a-427c-a3b9-3753e6a9253c tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-1668e209-6c60-4c78-b9a9-afb914175f34-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7245fe08-d71d-417b-b206-b3ebeaabfdac]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:52 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc Jul 17 15:31:52 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Acquiring lock "cinder-0f16754b-cb75-4be0-8f5a-96fe8ad28993-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Lock "cinder-0f16754b-cb75-4be0-8f5a-96fe8ad28993-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Acquiring lock "cinder-quobyte-0f16754b-cb75-4be0-8f5a-96fe8ad28993" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Lock "cinder-quobyte-0f16754b-cb75-4be0-8f5a-96fe8ad28993" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4485e19d-eca3-4656-a318-bb9e71c4551f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:53 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 Jul 17 15:31:53 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:53 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc" returned: 0 in 0.561s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:53 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc Jul 17 15:31:53 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:53 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993" returned: 0 in 0.406s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:53 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc" returned: 0 in 0.256s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:53 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993 Jul 17 15:31:53 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-quobyte-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc" released by "delete_volume" :: held 0.883s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Created reservations ['b4dfb4f2-9249-484f-821d-4502b2d80528', '965e2690-f3fb-4841-9a26-849a6fcbaf69', '560d1f0a-b22f-412a-bc9a-849fb407b47a', 'd154b4cb-fc71-450b-bc4a-9bb2045cccee'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:53 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:53 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:53 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0f16754b-cb75-4be0-8f5a-96fe8ad28993" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Lock "cinder-quobyte-0f16754b-cb75-4be0-8f5a-96fe8ad28993" released by "delete_volume" :: held 0.747s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Created reservations ['2362443e-7d4a-4c65-a0e7-628cb4ab17f3', '2b969b6d-b6b6-4547-af09-31f5de67bc68', '40befa15-d9a2-4d8b-8367-6cafb40bd7ad', 'a8cc7cee-148b-4b12-9508-3f989c352c89'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:53 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:53 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:53 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Deleted volume successfully. Jul 17 15:31:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-128ba201-91db-46a2-8ab6-dd6f593c1461 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-18192bbb-bd81-424e-b4f4-30ee6eb7c8bc-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:54 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.291s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:54 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Deleted volume successfully. Jul 17 15:31:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fbd8fd26-c74b-495d-88c0-a16574176f47 tempest-VolumesServicesTestJSON-1050939677 None] Lock "cinder-0f16754b-cb75-4be0-8f5a-96fe8ad28993-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "cinder-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "cinder-quobyte-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:31:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-quobyte-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:31:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[083568e2-ba66-4f5e-88fc-341f94727126]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:31:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:55 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa Jul 17 15:31:55 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:55 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa" returned: 0 in 0.439s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:55 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa Jul 17 15:31:55 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:55 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa" returned: 0 in 0.282s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-quobyte-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa" released by "delete_volume" :: held 0.779s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Created reservations ['db2b633c-f4cc-4f8a-a8a3-767518abc4f0', '69ead468-9da4-47c4-99ff-062667a3c3b6', 'b30bdfd4-e116-4ca9-b700-d9fe41eaf676', '27c362ce-5ac7-439f-a9c0-9aee9af522ab'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:31:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:31:55 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:31:55 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:31:56 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 17 15:31:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.398s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:31:56 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:31:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Deleted volume successfully. Jul 17 15:31:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-18e39146-120a-470d-ba99-dc7807a6ae15 tempest-VolumesListAdminTestJSON-1930415947 None] Lock "cinder-3b2ed739-1ebf-4e57-9d6b-cebcf0aa3ffa-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Flow 'volume_create_manager' (9f1a8cd3-a6f2-4aa9-8c1a-160c634af4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cd225b-842a-4754-b0dd-bb2e37bf389e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cd225b-842a-4754-b0dd-bb2e37bf389e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2108397417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107f87b9-124b-49f7-af05-5c31554d4671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccdae0ed1f94eb1a0293cb3c6ae7637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:05Z,use_quota=True,user_id='a7665295ab604740b432da4c461f5de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b5ab65-db98-4ffe-8c90-7bd392fbfa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b5ab65-db98-4ffe-8c90-7bd392fbfa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6377279f-5e8a-4066-b075-ed0acfdc4304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6377279f-5e8a-4066-b075-ed0acfdc4304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107f87b9-124b-49f7-af05-5c31554d4671', 'volume_name': 'volume-107f87b9-124b-49f7-af05-5c31554d4671', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdca6313-eae6-43ec-a1aa-3e565d9152de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdca6313-eae6-43ec-a1aa-3e565d9152de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03054e4f-ef31-4d92-afd5-658a4d16e8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:05 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Volume 107f87b9-124b-49f7-af05-5c31554d4671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107f87b9-124b-49f7-af05-5c31554d4671', 'volume_size': 1} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2108397417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107f87b9-124b-49f7-af05-5c31554d4671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccdae0ed1f94eb1a0293cb3c6ae7637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:05Z,use_quota=True,user_id='a7665295ab604740b432da4c461f5de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Creating volume 107f87b9-124b-49f7-af05-5c31554d4671 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:05 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:05 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671 1073741824 Jul 17 15:32:05 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:05 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671 1073741824" returned: 0 in 0.433s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:05 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671 Jul 17 15:32:05 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:06 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671" returned: 0 in 0.250s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03054e4f-ef31-4d92-afd5-658a4d16e8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107f87b9-124b-49f7-af05-5c31554d4671', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a2a341-dfd9-4ce6-98ca-a13763e0910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:06 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Volume volume-107f87b9-124b-49f7-af05-5c31554d4671 (107f87b9-124b-49f7-af05-5c31554d4671): created successfully Jul 17 15:32:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a2a341-dfd9-4ce6-98ca-a13763e0910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Flow 'volume_create_manager' (9f1a8cd3-a6f2-4aa9-8c1a-160c634af4f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4c2f1e54-e2eb-404a-a80d-9f48903148e3 tempest-VolumesTransfersV357Test-1777806941 None] Created volume successfully. Jul 17 15:32:07 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4f18fb6e-759c-4673-8de0-219aa5897fcf tempest-VolumesTransfersV357Test-398031633 None] Transfer volume completed successfully. Jul 17 15:32:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Acquiring lock "cinder-107f87b9-124b-49f7-af05-5c31554d4671-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Lock "cinder-107f87b9-124b-49f7-af05-5c31554d4671-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Acquiring lock "cinder-quobyte-107f87b9-124b-49f7-af05-5c31554d4671" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Lock "cinder-quobyte-107f87b9-124b-49f7-af05-5c31554d4671" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:07 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29dda97-c35d-4719-ac59-faafb7e188fb]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:07 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671 Jul 17 15:32:07 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:08 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671" returned: 0 in 0.391s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:08 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671 Jul 17 15:32:08 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:08 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-107f87b9-124b-49f7-af05-5c31554d4671" returned: 0 in 0.280s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Lock "cinder-quobyte-107f87b9-124b-49f7-af05-5c31554d4671" released by "delete_volume" :: held 0.749s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Created reservations ['38a23496-df8f-4390-9ea0-8f623ee4ec85', '99a563eb-2695-422d-94db-7e546473b60f', 'c058c776-13e7-4f39-bf09-5bb719735f9c', 'ffd21fde-51f8-48bc-b6f4-ad71626df682'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:08 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:32:08 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:08 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.500s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:32:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Deleted volume successfully. Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1bd334a2-d6ad-4cbc-a7f6-fd06184ce1e4 tempest-VolumesTransfersV357Test-1838410860 None] Lock "cinder-107f87b9-124b-49f7-af05-5c31554d4671-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Flow 'volume_create_manager' (7639534f-67d5-418c-b4f2-3fc443e08b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b37840e-ba45-4122-ae88-1611f36affce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b37840e-ba45-4122-ae88-1611f36affce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-930441124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14480a07-e83c-40ec-84ec-80ee37efb286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccdae0ed1f94eb1a0293cb3c6ae7637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:10Z,use_quota=True,user_id='a7665295ab604740b432da4c461f5de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f99ae5c-73e7-413a-9118-5cd09a4804ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f99ae5c-73e7-413a-9118-5cd09a4804ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99da44ef-50db-4d61-8f3b-76065f7fcc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99da44ef-50db-4d61-8f3b-76065f7fcc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14480a07-e83c-40ec-84ec-80ee37efb286', 'volume_name': 'volume-14480a07-e83c-40ec-84ec-80ee37efb286', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a37067-453d-4d94-94ad-3dc03834ccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a37067-453d-4d94-94ad-3dc03834ccd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af82e284-075a-46eb-949d-64e571d3c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:09 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Volume 14480a07-e83c-40ec-84ec-80ee37efb286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14480a07-e83c-40ec-84ec-80ee37efb286', 'volume_size': 1} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-930441124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14480a07-e83c-40ec-84ec-80ee37efb286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccdae0ed1f94eb1a0293cb3c6ae7637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:10Z,use_quota=True,user_id='a7665295ab604740b432da4c461f5de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Creating volume 14480a07-e83c-40ec-84ec-80ee37efb286 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:09 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:09 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286 1073741824 Jul 17 15:32:09 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:10 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286 1073741824" returned: 0 in 0.626s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:10 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286 Jul 17 15:32:10 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:10 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286" returned: 0 in 0.478s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af82e284-075a-46eb-949d-64e571d3c137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14480a07-e83c-40ec-84ec-80ee37efb286', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767686aa-1301-4049-8b39-b860f87847aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:11 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Volume volume-14480a07-e83c-40ec-84ec-80ee37efb286 (14480a07-e83c-40ec-84ec-80ee37efb286): created successfully Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767686aa-1301-4049-8b39-b860f87847aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Flow 'volume_create_manager' (7639534f-67d5-418c-b4f2-3fc443e08b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fb3cb815-8448-4f6b-8996-84175fbc16b7 tempest-VolumesTransfersV357Test-1777806941 None] Created volume successfully. Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Flow 'volume_create_manager' (40200af8-5721-4398-8282-171103c487bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1983c3-349f-4c2c-8770-5d3cff79bccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1983c3-349f-4c2c-8770-5d3cff79bccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-537661541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b2f35f-690f-4b2d-81e0-61d7168804b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7232972cc93d42b98b36b1973d76ef05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:11Z,use_quota=True,user_id='7b5db4a19610426fb43fd8b842675ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ddb50c-e0e5-4492-9e1e-95f92ce3e5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ddb50c-e0e5-4492-9e1e-95f92ce3e5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042ab8b3-6952-4d8d-951b-1beaa06abadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042ab8b3-6952-4d8d-951b-1beaa06abadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b2f35f-690f-4b2d-81e0-61d7168804b9', 'volume_name': 'volume-46b2f35f-690f-4b2d-81e0-61d7168804b9', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55be2944-1783-4977-bfaa-e861ba71d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55be2944-1783-4977-bfaa-e861ba71d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7775769-cfdf-429c-be49-073d1fec1be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:11 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Volume 46b2f35f-690f-4b2d-81e0-61d7168804b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b2f35f-690f-4b2d-81e0-61d7168804b9', 'volume_size': 1} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-537661541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b2f35f-690f-4b2d-81e0-61d7168804b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7232972cc93d42b98b36b1973d76ef05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:11Z,use_quota=True,user_id='7b5db4a19610426fb43fd8b842675ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Creating volume 46b2f35f-690f-4b2d-81e0-61d7168804b9 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:11 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:11 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 1073741824 Jul 17 15:32:11 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:11 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 1073741824" returned: 0 in 0.561s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:11 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 Jul 17 15:32:11 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Acquiring lock "cinder-14480a07-e83c-40ec-84ec-80ee37efb286-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Lock "cinder-14480a07-e83c-40ec-84ec-80ee37efb286-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:12 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9" returned: 0 in 0.335s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7775769-cfdf-429c-be49-073d1fec1be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b2f35f-690f-4b2d-81e0-61d7168804b9', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbe4ce1-d022-479f-91c2-18f0a979d78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Acquiring lock "cinder-quobyte-14480a07-e83c-40ec-84ec-80ee37efb286" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:12 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Volume volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 (46b2f35f-690f-4b2d-81e0-61d7168804b9): created successfully Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbe4ce1-d022-479f-91c2-18f0a979d78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Flow 'volume_create_manager' (40200af8-5721-4398-8282-171103c487bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Lock "cinder-quobyte-14480a07-e83c-40ec-84ec-80ee37efb286" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:12 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-062faeaa-8fa2-4720-b692-558db4228aea tempest-AttachVolumeNegativeTest-857928603 None] Created volume successfully. Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac132c6-4e78-4fd8-95b1-36abee5b0835]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:12 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286 Jul 17 15:32:12 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:12 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286" returned: 0 in 0.379s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:12 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286 Jul 17 15:32:12 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:13 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-14480a07-e83c-40ec-84ec-80ee37efb286" returned: 0 in 0.379s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Lock "cinder-quobyte-14480a07-e83c-40ec-84ec-80ee37efb286" released by "delete_volume" :: held 0.829s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Created reservations ['532ba8e8-72bd-4272-b03b-93a923da89c0', 'b09b11f0-b6b1-4583-bb1f-8a3f7d439118', 'f6344ee2-cc2f-4036-bfe5-d5f8dc15577b', '4384ceaa-c4fc-4edd-84db-b3a3b17c58ff'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:13 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:32:13 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:13 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.388s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:32:13 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Deleted volume successfully. Jul 17 15:32:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c1f9fecc-4311-4875-b0ef-012406c113ca tempest-VolumesTransfersV357Test-1838410860 None] Lock "cinder-14480a07-e83c-40ec-84ec-80ee37efb286-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-20a5de23-c11c-46cb-a0b3-ce68b5ed4b48 req-4d23b2ad-94fb-4681-aeba-e53a3cac2df7 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-20a5de23-c11c-46cb-a0b3-ce68b5ed4b48 req-4d23b2ad-94fb-4681-aeba-e53a3cac2df7 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-20a5de23-c11c-46cb-a0b3-ce68b5ed4b48 req-4d23b2ad-94fb-4681-aeba-e53a3cac2df7 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:14 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-20a5de23-c11c-46cb-a0b3-ce68b5ed4b48 req-4d23b2ad-94fb-4681-aeba-e53a3cac2df7 tempest-AttachVolumeNegativeTest-857928603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-46b2f35f-690f-4b2d-81e0-61d7168804b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '230eb907-68ee-4c88-9789-1b54d8897b93', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:32:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-20a5de23-c11c-46cb-a0b3-ce68b5ed4b48 req-4d23b2ad-94fb-4681-aeba-e53a3cac2df7 tempest-AttachVolumeNegativeTest-857928603 None] attachment_update completed successfully. Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Flow 'volume_create_manager' (02699dfb-dc4b-4cd6-92c2-e86fabe71488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df39d2c-378a-4e33-98e9-bf42cdaa362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df39d2c-378a-4e33-98e9-bf42cdaa362e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-623834289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e98945e-844f-41f1-a7a7-c1ad3b60f5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a669ff17549ce904a6ecc44112d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:21Z,use_quota=True,user_id='8e4174c0768b4271b45e8a40aebd1a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bacb29e-6ddd-4905-9935-5ccf9682caf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bacb29e-6ddd-4905-9935-5ccf9682caf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1bc9eb-b0ce-45ea-8023-f971d6eda321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1bc9eb-b0ce-45ea-8023-f971d6eda321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e98945e-844f-41f1-a7a7-c1ad3b60f5b1', 'volume_name': 'volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1', 'volume_size': 2}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4683d9d-8177-478b-867e-901bfba4fe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4683d9d-8177-478b-867e-901bfba4fe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b58a62b-6ed9-4e8e-b642-e2a5cf016adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Volume 7e98945e-844f-41f1-a7a7-c1ad3b60f5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1', 'volume_size': 2} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-623834289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e98945e-844f-41f1-a7a7-c1ad3b60f5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645a669ff17549ce904a6ecc44112d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:21Z,use_quota=True,user_id='8e4174c0768b4271b45e8a40aebd1a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Creating volume 7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:21 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 2147483648 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:21 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 2147483648 Jul 17 15:32:21 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:21 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 2147483648" returned: 0 in 0.691s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:21 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 Jul 17 15:32:21 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:22 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1" returned: 0 in 0.317s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b58a62b-6ed9-4e8e-b642-e2a5cf016adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1', 'volume_size': 2}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d3cca2-a57b-496b-bdae-f571ba0a3530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:22 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Volume volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 (7e98945e-844f-41f1-a7a7-c1ad3b60f5b1): created successfully Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d3cca2-a57b-496b-bdae-f571ba0a3530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Flow 'volume_create_manager' (02699dfb-dc4b-4cd6-92c2-e86fabe71488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8592e64c-972f-4d58-aebe-992844e99f47 tempest-VolumesCloneNegativeTest-1609727888 None] Created volume successfully. Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:22 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:32:22 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:23 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.308s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 8 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Acquiring lock "cinder-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Lock "cinder-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Acquiring lock "cinder-quobyte-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Lock "cinder-quobyte-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e5222c-21a7-408e-acb4-b46296eaf6b4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:23 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 Jul 17 15:32:23 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:24 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1" returned: 0 in 0.517s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:24 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1 Jul 17 15:32:24 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:24 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1" returned: 0 in 0.356s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Lock "cinder-quobyte-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1" released by "delete_volume" :: held 0.946s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Created reservations ['28cd5748-5844-4e0d-b6a0-3de713510c35', '18a4cfaf-46e3-419c-80f8-65736dcf6f8f', '1838c65d-5f1d-419b-b210-5dd245caf627', '50af0226-c759-4374-a23d-4e882df0ffe7'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:24 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:32:24 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:25 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:25 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:32:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Deleted volume successfully. Jul 17 15:32:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-48ec6c8c-5edc-464e-8200-e57b87ad694a tempest-VolumesCloneNegativeTest-1609727888 None] Lock "cinder-7e98945e-844f-41f1-a7a7-c1ad3b60f5b1-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (49b501d4-86bd-4681-82dd-e17c305d17c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d276ebfc-e5c5-426b-9553-18dee6a458ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=112,cinder:SELECT=79,cinder:INSERT=18,cinder:DELETE=10 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d276ebfc-e5c5-426b-9553-18dee6a458ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-732324043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9251a69-bb2c-4474-8cd5-bf5e42182aac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:30Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a560ca-2be6-4c6f-84be-529f38a0ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a560ca-2be6-4c6f-84be-529f38a0ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce7ccf2-3ce0-444b-9879-334663f54440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce7ccf2-3ce0-444b-9879-334663f54440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9251a69-bb2c-4474-8cd5-bf5e42182aac', 'volume_name': 'volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a514ad5b-1636-4f56-bb50-48c528c1e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a514ad5b-1636-4f56-bb50-48c528c1e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c8d941-a7f8-45d6-a6e4-afc5c276f0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:30 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Volume b9251a69-bb2c-4474-8cd5-bf5e42182aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac', 'volume_size': 1} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-732324043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9251a69-bb2c-4474-8cd5-bf5e42182aac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:30Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Creating volume b9251a69-bb2c-4474-8cd5-bf5e42182aac {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:30 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:30 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac 1073741824 Jul 17 15:32:30 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:31 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac 1073741824" returned: 0 in 0.728s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:31 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac Jul 17 15:32:31 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:31 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac" returned: 0 in 0.580s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c8d941-a7f8-45d6-a6e4-afc5c276f0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e88f34-3da9-4314-afa3-aeda05967bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:31 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Volume volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac (b9251a69-bb2c-4474-8cd5-bf5e42182aac): created successfully Jul 17 15:32:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e88f34-3da9-4314-afa3-aeda05967bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (49b501d4-86bd-4681-82dd-e17c305d17c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:31 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c2b683e6-f072-463b-930d-9503bf0b52c6 tempest-VolumesGetTest-396318636 None] Created volume successfully. Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (468859b0-b103-44fc-9f83-7b76cd70de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56bb428e-831f-46a0-9bb2-54c1e6756461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56bb428e-831f-46a0-9bb2-54c1e6756461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-900904306',display_name='tempest-VolumesGetTest-Volume-654507745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca8ff30-8024-46b6-a719-385bb6c7a6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:34Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991bb1fe-8502-4d69-9824-39b27097aa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991bb1fe-8502-4d69-9824-39b27097aa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04739a3e-a680-43c1-9f76-561b8437e101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04739a3e-a680-43c1-9f76-561b8437e101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca8ff30-8024-46b6-a719-385bb6c7a6e0', 'volume_name': 'volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488a5a06-dfcd-4bd6-b9be-9d6ebf6ce677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488a5a06-dfcd-4bd6-b9be-9d6ebf6ce677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a54403d-52a1-4b68-bf11-4528a4c69270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:33 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Volume 6ca8ff30-8024-46b6-a719-385bb6c7a6e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0', 'volume_size': 1} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-900904306',display_name='tempest-VolumesGetTest-Volume-654507745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca8ff30-8024-46b6-a719-385bb6c7a6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:34Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Creating volume 6ca8ff30-8024-46b6-a719-385bb6c7a6e0 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:33 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:33 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 1073741824 Jul 17 15:32:33 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:34 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 1073741824" returned: 0 in 0.761s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:34 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 Jul 17 15:32:34 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:35 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0" returned: 0 in 0.351s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a54403d-52a1-4b68-bf11-4528a4c69270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497e0948-62ed-4809-9725-c92358c84bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:35 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Volume volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 (6ca8ff30-8024-46b6-a719-385bb6c7a6e0): created successfully Jul 17 15:32:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497e0948-62ed-4809-9725-c92358c84bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (468859b0-b103-44fc-9f83-7b76cd70de5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:35 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c3bd3660-58a8-4299-b85c-967c4334b51d tempest-VolumesGetTest-396318636 None] Created volume successfully. Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-6ca8ff30-8024-46b6-a719-385bb6c7a6e0-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Lock "cinder-6ca8ff30-8024-46b6-a719-385bb6c7a6e0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-quobyte-6ca8ff30-8024-46b6-a719-385bb6c7a6e0" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-6ca8ff30-8024-46b6-a719-385bb6c7a6e0" acquired by "delete_volume" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbb16ba-fbbe-4efc-b59b-ef436a6d59b8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:36 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 Jul 17 15:32:36 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (33f4013e-ba2c-4c66-b992-9e48925261aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dc7daf-eded-48bf-8ef4-f9d2e60940af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dc7daf-eded-48bf-8ef4-f9d2e60940af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1187352987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52520ad9-d1d7-454c-9103-f899ce9fd0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:36Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3ffe65-0580-4030-b392-84a2ab0f0567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3ffe65-0580-4030-b392-84a2ab0f0567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fa6dd7-3a2b-49c2-85da-7b8c5937aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fa6dd7-3a2b-49c2-85da-7b8c5937aed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52520ad9-d1d7-454c-9103-f899ce9fd0da', 'volume_name': 'volume-52520ad9-d1d7-454c-9103-f899ce9fd0da', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910e1485-4f38-45ed-a861-bee2cead3093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910e1485-4f38-45ed-a861-bee2cead3093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba28ebbe-18c2-4fbd-94e2-43afacc62f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:36 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Volume 52520ad9-d1d7-454c-9103-f899ce9fd0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52520ad9-d1d7-454c-9103-f899ce9fd0da', 'volume_size': 1} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1187352987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52520ad9-d1d7-454c-9103-f899ce9fd0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:36Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Creating volume 52520ad9-d1d7-454c-9103-f899ce9fd0da {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:36 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:36 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da 1073741824 Jul 17 15:32:36 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:36 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0" returned: 0 in 0.654s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:36 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0 Jul 17 15:32:36 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:37 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da 1073741824" returned: 0 in 0.541s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:37 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6ca8ff30-8024-46b6-a719-385bb6c7a6e0" returned: 0 in 0.328s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-6ca8ff30-8024-46b6-a719-385bb6c7a6e0" released by "delete_volume" :: held 1.046s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:37 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da Jul 17 15:32:37 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Created reservations ['c00fc554-3845-48e4-a774-f706ab447971', '76123101-c7e8-4e0f-8140-6f50d3517bed', '17fd82bc-cef4-47ad-81f7-8bbba96e2e06', '59a7f3ea-b064-45b2-a244-f12b93308409'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:37 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:32:37 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:37 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da" returned: 0 in 0.515s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:37 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.418s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba28ebbe-18c2-4fbd-94e2-43afacc62f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52520ad9-d1d7-454c-9103-f899ce9fd0da', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c349da-3401-4ad9-af87-2ff63f1044e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:37 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Deleted volume successfully. Jul 17 15:32:37 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Volume volume-52520ad9-d1d7-454c-9103-f899ce9fd0da (52520ad9-d1d7-454c-9103-f899ce9fd0da): created successfully Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c349da-3401-4ad9-af87-2ff63f1044e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (33f4013e-ba2c-4c66-b992-9e48925261aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ac934c09-3639-4470-92f7-1579251920c1 tempest-VolumesGetTest-396318636 None] Lock "cinder-6ca8ff30-8024-46b6-a719-385bb6c7a6e0-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:37 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ac66eb47-0f66-4e7f-86e7-3ffd162669b5 tempest-VolumesActionsTest-1881940488 None] Created volume successfully. Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-b9251a69-bb2c-4474-8cd5-bf5e42182aac-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Lock "cinder-b9251a69-bb2c-4474-8cd5-bf5e42182aac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-quobyte-b9251a69-bb2c-4474-8cd5-bf5e42182aac" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-b9251a69-bb2c-4474-8cd5-bf5e42182aac" acquired by "delete_volume" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ddaf23da-be16-4f2c-a0ed-edae0b540abf tempest-VolumesActionsTest-1881940488 None] Acquiring lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da" by "attach_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c113b3b5-a85a-4268-9a32-b2357591fcba]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ddaf23da-be16-4f2c-a0ed-edae0b540abf tempest-VolumesActionsTest-1881940488 None] Lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da" acquired by "attach_volume" :: waited 0.072s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=119,cinder:SELECT=86,cinder:INSERT=32,cinder:DELETE=12 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:32:38 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ddaf23da-be16-4f2c-a0ed-edae0b540abf tempest-VolumesActionsTest-1881940488 None] Attaching volume 52520ad9-d1d7-454c-9103-f899ce9fd0da to instance 3b018012-556e-4098-b923-c8bbdf6e03b3 at mountpoint /dev/vdb on host None. Jul 17 15:32:38 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac Jul 17 15:32:38 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:38 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ddaf23da-be16-4f2c-a0ed-edae0b540abf tempest-VolumesActionsTest-1881940488 None] Attach volume completed successfully. Jul 17 15:32:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ddaf23da-be16-4f2c-a0ed-edae0b540abf tempest-VolumesActionsTest-1881940488 None] Lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da" released by "attach_volume" :: held 0.172s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:39 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac" returned: 0 in 0.550s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:39 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac Jul 17 15:32:39 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:39 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9251a69-bb2c-4474-8cd5-bf5e42182aac" returned: 0 in 0.302s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-b9251a69-bb2c-4474-8cd5-bf5e42182aac" released by "delete_volume" :: held 0.927s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:39 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0467d7ce-64f4-4fa4-a625-9a58f1f12203 tempest-VolumesActionsTest-1750140723 None] Terminate volume connection completed successfully. Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Created reservations ['86cb3e1a-d471-46ec-a7e1-b607ffa6129d', '2df7d88b-75c3-499a-9c14-4be606009d32', 'f69fef96-7477-454f-a7dd-b8c073c1f149', '432b4d6c-7da0-4658-add1-658db7f82d6d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0467d7ce-64f4-4fa4-a625-9a58f1f12203 tempest-VolumesActionsTest-1750140723 None] Acquiring lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da-detach_volume" by "detach_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0467d7ce-64f4-4fa4-a625-9a58f1f12203 tempest-VolumesActionsTest-1750140723 None] Lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:39 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:32:39 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0467d7ce-64f4-4fa4-a625-9a58f1f12203 tempest-VolumesActionsTest-1750140723 None] Detaching volume 52520ad9-d1d7-454c-9103-f899ce9fd0da from instance 3b018012-556e-4098-b923-c8bbdf6e03b3. Jul 17 15:32:39 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:39 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0467d7ce-64f4-4fa4-a625-9a58f1f12203 tempest-VolumesActionsTest-1750140723 None] Detach volume completed successfully. Jul 17 15:32:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0467d7ce-64f4-4fa4-a625-9a58f1f12203 tempest-VolumesActionsTest-1750140723 None] Lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ed710117-2ea5-4e6b-9e20-550669cdcc92 tempest-VolumesActionsTest-1881940488 None] Acquiring lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da-detach_volume" by "detach_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ed710117-2ea5-4e6b-9e20-550669cdcc92 tempest-VolumesActionsTest-1881940488 None] Lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:40 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ed710117-2ea5-4e6b-9e20-550669cdcc92 tempest-VolumesActionsTest-1881940488 None] Volume detach called, but volume not attached. Jul 17 15:32:40 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ed710117-2ea5-4e6b-9e20-550669cdcc92 tempest-VolumesActionsTest-1881940488 None] Lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.408s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:32:40 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Deleted volume successfully. Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-779266cd-d3ed-4db1-8a30-1c9a2b98c046 tempest-VolumesGetTest-396318636 None] Lock "cinder-b9251a69-bb2c-4474-8cd5-bf5e42182aac-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Acquiring lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Acquiring lock "cinder-quobyte-52520ad9-d1d7-454c-9103-f899ce9fd0da" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Lock "cinder-quobyte-52520ad9-d1d7-454c-9103-f899ce9fd0da" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[26109bfa-91a6-4167-93d5-31397058f8ed]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:40 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da Jul 17 15:32:40 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:41 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da" returned: 0 in 0.464s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:41 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da Jul 17 15:32:41 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:41 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (c78598e1-6f35-41cf-bcb3-52ecf4180167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ac6846-38b3-4e1a-b40c-db8148722be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-52520ad9-d1d7-454c-9103-f899ce9fd0da" returned: 0 in 0.450s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ac6846-38b3-4e1a-b40c-db8148722be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1686054501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46be23ef-6562-499b-8603-a766d57fcf3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:41Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac54a3d-ab30-4577-aaa3-a22f49a2ab6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac54a3d-ab30-4577-aaa3-a22f49a2ab6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6bffe9-a8e4-4ea6-a0dd-f106024e8a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6bffe9-a8e4-4ea6-a0dd-f106024e8a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46be23ef-6562-499b-8603-a766d57fcf3a', 'volume_name': 'volume-46be23ef-6562-499b-8603-a766d57fcf3a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f273ba-7ced-4d13-8df3-a6cd3919d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f273ba-7ced-4d13-8df3-a6cd3919d319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231a17ca-4bfb-4011-a736-22891ac52ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:41 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Volume 46be23ef-6562-499b-8603-a766d57fcf3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46be23ef-6562-499b-8603-a766d57fcf3a', 'volume_size': 1} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1686054501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46be23ef-6562-499b-8603-a766d57fcf3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:41Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Creating volume 46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:41 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Lock "cinder-quobyte-52520ad9-d1d7-454c-9103-f899ce9fd0da" released by "delete_volume" :: held 1.033s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:41 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a 1073741824 Jul 17 15:32:41 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Created reservations ['39a6edfd-fe9b-41e6-9f5d-c5a862637543', 'fcb4f672-b0c8-4c37-b3a8-ef3fd4d8d797', 'daf59720-777d-4c91-994d-75b73d375f40', 'e9121dcf-bea3-4f1b-87f9-1d27a13ee375'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:41 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:32:41 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:42 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.308s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:32:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Deleted volume successfully. Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b482e47c-36ff-409f-b47b-192141f6119e tempest-VolumesActionsTest-1881940488 None] Lock "cinder-52520ad9-d1d7-454c-9103-f899ce9fd0da-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:42 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a 1073741824" returned: 0 in 0.612s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:42 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a Jul 17 15:32:42 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:42 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a" returned: 0 in 0.296s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231a17ca-4bfb-4011-a736-22891ac52ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46be23ef-6562-499b-8603-a766d57fcf3a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2f84b2-eb32-4ee4-a491-663a17000942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:42 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Volume volume-46be23ef-6562-499b-8603-a766d57fcf3a (46be23ef-6562-499b-8603-a766d57fcf3a): created successfully Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2f84b2-eb32-4ee4-a491-663a17000942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (c78598e1-6f35-41cf-bcb3-52ecf4180167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0ac96649-f28f-460c-b59f-7450dc28cd89 tempest-VolumesGetTest-396318636 None] Created volume successfully. Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (6cc4c87e-8312-4480-87c8-fe673a682b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61f23da-a008-4ee9-8fa8-a1be742bfdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61f23da-a008-4ee9-8fa8-a1be742bfdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-772380559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dddff82-42f8-42d5-8345-d910758bb02c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=46be23ef-6562-499b-8603-a766d57fcf3a,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:44Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e7223-4f16-438a-be07-b55c695cbf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e7223-4f16-438a-be07-b55c695cbf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cd7077-fab5-4a0b-8b78-81fc79ef3d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cd7077-fab5-4a0b-8b78-81fc79ef3d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0dddff82-42f8-42d5-8345-d910758bb02c', 'volume_name': 'volume-0dddff82-42f8-42d5-8345-d910758bb02c', 'volume_size': 1, 'source_volid': '46be23ef-6562-499b-8603-a766d57fcf3a', 'source_volstatus': 'available'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5190f72d-84a7-4274-a4f1-c16dc4c51781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5190f72d-84a7-4274-a4f1-c16dc4c51781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a83eaf-1541-4e1c-b2c0-3b3dc3dad331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:44 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Volume 0dddff82-42f8-42d5-8345-d910758bb02c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0dddff82-42f8-42d5-8345-d910758bb02c', 'volume_size': 1, 'source_volid': '46be23ef-6562-499b-8603-a766d57fcf3a', 'source_volstatus': 'available'} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:44 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Cloning volume 46be23ef-6562-499b-8603-a766d57fcf3a to volume 0dddff82-42f8-42d5-8345-d910758bb02c Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Creating offline snapshot 6e28a1f8-df69-4c3d-a989-06991a0fb66b of volume 46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c447a4fb-c6ca-4ac4-99f9-05ca0176ad8a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:44 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a Jul 17 15:32:44 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:45 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a" returned: 0 in 0.427s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:45 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b 1G Jul 17 15:32:45 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:45 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b 1G" returned: 0 in 0.437s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46be23ef-6562-499b-8603-a766d57fcf3a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:45 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46be23ef-6562-499b-8603-a766d57fcf3a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b Jul 17 15:32:45 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:46 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46be23ef-6562-499b-8603-a766d57fcf3a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b" returned: 0 in 0.408s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:46 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b is being set with open permissions: ugo+rw Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:46 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b Jul 17 15:32:46 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (f74803ae-64d7-4ef9-9050-03e61f94c35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582337a9-a95c-4465-a9f9-af203d75487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:46 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b" returned: 0 in 0.281s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582337a9-a95c-4465-a9f9-af203d75487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1700490241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:46Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c86d77b-aff8-42cf-9837-0ea3b964abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c86d77b-aff8-42cf-9837-0ea3b964abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690e2a30-1cbb-419e-b82b-2c91cd29dcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690e2a30-1cbb-419e-b82b-2c91cd29dcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a', 'volume_name': 'volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583390a3-af5d-40f8-aab2-959c45a0aa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583390a3-af5d-40f8-aab2-959c45a0aa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33c1f72-3495-4405-b20e-f083ed8530c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:46 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Volume 0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a', 'volume_size': 1} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:46 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.info Jul 17 15:32:46 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:46 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.info" returned: 0 in 0.255s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:46 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.info is being set with open permissions: ugo+rw Jul 17 15:32:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:46 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.info Jul 17 15:32:46 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:47 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.info" returned: 0 in 0.273s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-quobyte-0dddff82-42f8-42d5-8345-d910758bb02c" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-0dddff82-42f8-42d5-8345-d910758bb02c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] snapshot: 6e28a1f8-df69-4c3d-a989-06991a0fb66b, volume: 0dddff82-42f8-42d5-8345-d910758bb02c, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[90da2591-3282-4619-8770-c5cb0699b612]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:47 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b Jul 17 15:32:47 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:47 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b" returned: 0 in 0.357s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46be23ef-6562-499b-8603-a766d57fcf3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c86fc1e-f815-4997-965f-f765628355b8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:47 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a Jul 17 15:32:47 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:47 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a" returned: 0 in 0.356s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:32:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:47 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c Jul 17 15:32:47 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:52 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c" returned: 0 in 4.462s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0920ae-f1d8-416a-956f-db0e6ab8f98b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:52 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a Jul 17 15:32:52 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:52 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a" returned: 0 in 0.538s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:52 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:32:52 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Converted 1024.00 MB image at 229.41 MB/s Jul 17 15:32:52 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c is being set with open permissions: ugo+rw Jul 17 15:32:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:52 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c Jul 17 15:32:52 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:53 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c" returned: 0 in 0.239s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-0dddff82-42f8-42d5-8345-d910758bb02c" released by "_copy_volume_from_snapshot" :: held 6.036s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-quobyte-6e28a1f8-df69-4c3d-a989-06991a0fb66b" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-6e28a1f8-df69-4c3d-a989-06991a0fb66b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Deleting offline snapshot 6e28a1f8-df69-4c3d-a989-06991a0fb66b of volume 46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] snapshot_file for this snap is: volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b3cba-4553-4b7f-8391-1f283de49769]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:53 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b Jul 17 15:32:53 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:53 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b" returned: 0 in 0.364s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46be23ef-6562-499b-8603-a766d57fcf3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[952a1fdb-caa8-4795-bff9-042c99ea2346]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:53 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a Jul 17 15:32:53 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:53 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a" returned: 0 in 0.352s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:53 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b Jul 17 15:32:53 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:54 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b" returned: 0 in 0.367s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:54 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b Jul 17 15:32:54 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:54 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a.6e28a1f8-df69-4c3d-a989-06991a0fb66b" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-6e28a1f8-df69-4c3d-a989-06991a0fb66b" released by "_delete_snapshot" :: held 1.438s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.826s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.134s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1700490241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:46Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Creating volume 0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:54 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:54 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a 1073741824 Jul 17 15:32:54 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a83eaf-1541-4e1c-b2c0-3b3dc3dad331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dddff82-42f8-42d5-8345-d910758bb02c', 'volume_size': 1, 'source_volid': '46be23ef-6562-499b-8603-a766d57fcf3a', 'source_volstatus': 'available'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4fefef-2bc5-48f3-8654-52395e68dba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:54 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Volume volume-0dddff82-42f8-42d5-8345-d910758bb02c (0dddff82-42f8-42d5-8345-d910758bb02c): created successfully Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4fefef-2bc5-48f3-8654-52395e68dba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (6cc4c87e-8312-4480-87c8-fe673a682b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9a3f4266-3fc3-4276-8303-eda5856fd4a9 tempest-VolumesGetTest-396318636 None] Created volume successfully. Jul 17 15:32:55 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a 1073741824" returned: 0 in 0.451s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:55 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a Jul 17 15:32:55 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:55 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a" returned: 0 in 0.289s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33c1f72-3495-4405-b20e-f083ed8530c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9d85bc-4d7b-4685-bb0c-6df6cfb251f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:55 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Volume volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a (0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a): created successfully Jul 17 15:32:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9d85bc-4d7b-4685-bb0c-6df6cfb251f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (f74803ae-64d7-4ef9-9050-03e61f94c35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0ba94e3c-6adb-43e9-9ff8-1bc8328d81dc tempest-VolumesActionsTest-1881940488 None] Created volume successfully. Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (72a1dd39-2ab9-409b-bd27-8a1a484d0f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980c2aa8-59a1-46f4-8eb6-e4a5b4781ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980c2aa8-59a1-46f4-8eb6-e4a5b4781ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-919262524',display_name='tempest-VolumesGetTest-Volume-744120616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f7be28-3cd6-40f4-8330-86adbcec3665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:56Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e60fe20-72ec-4049-bb94-2a71a1a0122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e60fe20-72ec-4049-bb94-2a71a1a0122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73a4372-530a-411c-94bf-78fc567898c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73a4372-530a-411c-94bf-78fc567898c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f7be28-3cd6-40f4-8330-86adbcec3665', 'volume_name': 'volume-31f7be28-3cd6-40f4-8330-86adbcec3665', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89c5c0a-cf00-4473-9335-8e9daaef1737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89c5c0a-cf00-4473-9335-8e9daaef1737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015c5dce-915e-46d7-97d6-8f7fb28850ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:56 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Volume 31f7be28-3cd6-40f4-8330-86adbcec3665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f7be28-3cd6-40f4-8330-86adbcec3665', 'volume_size': 1} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-919262524',display_name='tempest-VolumesGetTest-Volume-744120616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f7be28-3cd6-40f4-8330-86adbcec3665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:32:56Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Creating volume 31f7be28-3cd6-40f4-8330-86adbcec3665 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:56 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Acquiring lock "cinder-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:56 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665 1073741824 Jul 17 15:32:56 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Lock "cinder-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Acquiring lock "cinder-quobyte-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Lock "cinder-quobyte-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac82da3b-9052-4baf-80ce-3e4d8f142b42]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:57 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a Jul 17 15:32:57 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:57 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a" returned: 0 in 0.605s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:57 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a Jul 17 15:32:57 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:57 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665 1073741824" returned: 0 in 0.949s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:57 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665 Jul 17 15:32:57 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:57 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a" returned: 0 in 0.482s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:57 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665" returned: 0 in 0.289s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Lock "cinder-quobyte-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a" released by "delete_volume" :: held 1.142s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015c5dce-915e-46d7-97d6-8f7fb28850ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f7be28-3cd6-40f4-8330-86adbcec3665', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b906ecd-894d-44be-b0f5-a67092520451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:58 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Volume volume-31f7be28-3cd6-40f4-8330-86adbcec3665 (31f7be28-3cd6-40f4-8330-86adbcec3665): created successfully Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b906ecd-894d-44be-b0f5-a67092520451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (72a1dd39-2ab9-409b-bd27-8a1a484d0f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c23174b2-68a2-4c6b-a47a-6af95c39201a tempest-VolumesGetTest-396318636 None] Created volume successfully. Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Created reservations ['3dd826ef-eef8-423b-84bd-17914877460f', '2a26afc5-506d-4872-91cc-de0bbfede860', '7eb78e89-e25a-41cd-9749-785ee28ca958', '6b486fc1-625e-443b-9f71-effcec96023b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:58 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:32:58 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:58 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.449s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:32:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Deleted volume successfully. Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3e8269a5-42cb-4b24-8c3e-3ce071c4c43a tempest-VolumesActionsTest-1750140723 None] Lock "cinder-0aacd85d-8fd4-477c-ac76-5b83b1bd2d7a-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-31f7be28-3cd6-40f4-8330-86adbcec3665-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Lock "cinder-31f7be28-3cd6-40f4-8330-86adbcec3665-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-quobyte-31f7be28-3cd6-40f4-8330-86adbcec3665" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-31f7be28-3cd6-40f4-8330-86adbcec3665" acquired by "delete_volume" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfe92a2-b60e-43b1-a89b-334e244dacd3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:32:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:59 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665 Jul 17 15:32:59 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:59 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665" returned: 0 in 0.532s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:59 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665 Jul 17 15:32:59 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (ede93d5c-4c84-4050-bff4-e24293ff38f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:32:59 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6457d5dc-bece-4b4d-8bc4-9ec78ef1091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-31f7be28-3cd6-40f4-8330-86adbcec3665" returned: 0 in 0.343s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6457d5dc-bece-4b4d-8bc4-9ec78ef1091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-315852119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7a7b89-6856-42d3-a0fd-4a36ec58faa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:00Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195d5726-fe69-45bb-97b4-9e256510c05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195d5726-fe69-45bb-97b4-9e256510c05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bf2054-89a1-45fc-ba7b-3d000a7e5d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bf2054-89a1-45fc-ba7b-3d000a7e5d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b7a7b89-6856-42d3-a0fd-4a36ec58faa5', 'volume_name': 'volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e74b99-ebd1-4d10-b717-f8bafc0dee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e74b99-ebd1-4d10-b717-f8bafc0dee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a817552c-8df8-4644-a346-50734ce83aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:32:59 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Volume 1b7a7b89-6856-42d3-a0fd-4a36ec58faa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5', 'volume_size': 1} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-315852119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7a7b89-6856-42d3-a0fd-4a36ec58faa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:00Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Creating volume 1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:32:59 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-31f7be28-3cd6-40f4-8330-86adbcec3665" released by "delete_volume" :: held 1.026s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:32:59 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 1073741824 Jul 17 15:32:59 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:32:59 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Created reservations ['dd57ccf5-9952-4460-94e2-e77ef3373df4', 'ba42521c-5ea6-4015-b7e3-ba6d4e754d94', 'ec3bb811-d2a4-4d2f-978c-ba84d5ec55fa', '45e98b51-5747-48e2-9d13-44c0ac18b0d3'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:00 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:00 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:00 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Deleted volume successfully. Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-39b11119-dbfb-4d69-982e-a8597746a2b1 tempest-VolumesGetTest-396318636 None] Lock "cinder-31f7be28-3cd6-40f4-8330-86adbcec3665-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:00 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 1073741824" returned: 0 in 0.653s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:00 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 Jul 17 15:33:00 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:00 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5" returned: 0 in 0.297s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a817552c-8df8-4644-a346-50734ce83aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199377ff-aaf0-4d88-88e1-d52734987005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:00 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Volume volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 (1b7a7b89-6856-42d3-a0fd-4a36ec58faa5): created successfully Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199377ff-aaf0-4d88-88e1-d52734987005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (ede93d5c-4c84-4050-bff4-e24293ff38f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f1addc5e-e975-4b59-a36f-98a56273a4fb tempest-VolumesActionsTest-1881940488 None] Created volume successfully. Jul 17 15:33:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-0dddff82-42f8-42d5-8345-d910758bb02c-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Lock "cinder-0dddff82-42f8-42d5-8345-d910758bb02c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-quobyte-0dddff82-42f8-42d5-8345-d910758bb02c" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-0dddff82-42f8-42d5-8345-d910758bb02c" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ee1edc-4522-42ad-b5a7-12b530438519]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:01 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c Jul 17 15:33:01 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:01 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c" returned: 0 in 0.446s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:01 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c Jul 17 15:33:01 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:02 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0dddff82-42f8-42d5-8345-d910758bb02c" returned: 0 in 0.317s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-65ad9483-cd6a-4d42-b0c3-ebcbd2a0608a req-1d2abfc0-b803-43e7-b95f-1b20d45fd6a8 tempest-AttachVolumeNegativeTest-857928603 None] Terminate volume connection completed successfully. Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-65ad9483-cd6a-4d42-b0c3-ebcbd2a0608a req-1d2abfc0-b803-43e7-b95f-1b20d45fd6a8 tempest-AttachVolumeNegativeTest-857928603 None] Deleting attachment 230eb907-68ee-4c88-9789-1b54d8897b93. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Acquiring lock "cinder-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-0dddff82-42f8-42d5-8345-d910758bb02c" released by "delete_volume" :: held 0.831s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Lock "cinder-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Created reservations ['901b62fb-7fa3-4da6-9631-de65ec64aefd', 'b5d0be66-95f2-4ebb-ac18-5b80c1ef13f9', '79b15dbb-1cc3-43c0-907c-75b19a618702', '815eaebd-cb0d-4adc-9b28-e48928bb3842'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Acquiring lock "cinder-quobyte-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Lock "cinder-quobyte-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9948dd-8912-4759-a306-0ebbc6ecd5e9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:02 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:02 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:02 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 Jul 17 15:33:02 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-46be23ef-6562-499b-8603-a766d57fcf3a-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Lock "cinder-46be23ef-6562-499b-8603-a766d57fcf3a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-quobyte-46be23ef-6562-499b-8603-a766d57fcf3a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-46be23ef-6562-499b-8603-a766d57fcf3a" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d893f9-01a8-40a3-9bd5-dd221b2fe1d5]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:02 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5" returned: 0 in 0.499s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:02 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.444s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:02 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5 Jul 17 15:33:02 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Deleted volume successfully. Jul 17 15:33:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ed7fc12-8c62-4c85-bb13-7a9e477cb443 tempest-VolumesGetTest-396318636 None] Lock "cinder-0dddff82-42f8-42d5-8345-d910758bb02c-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:02 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a Jul 17 15:33:02 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:03 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5" returned: 0 in 0.355s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Lock "cinder-quobyte-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5" released by "delete_volume" :: held 0.923s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Created reservations ['0258742d-77f1-4323-a7f1-2bb85df2041f', 'f60b7ea9-71f1-4224-b727-3ba9d936cf69', '438e2817-5ed0-42a7-af67-69d204170590', 'f5f03c1b-fd5d-4f8c-bda8-7e17dd2e2af5'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:03 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a" returned: 0 in 0.625s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:03 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a Jul 17 15:33:03 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:03 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:03 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:03 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46be23ef-6562-499b-8603-a766d57fcf3a" returned: 0 in 0.467s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-46be23ef-6562-499b-8603-a766d57fcf3a" released by "delete_volume" :: held 1.193s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Created reservations ['f381a33b-0400-4b37-98fa-e6b5acd8578d', '7d761f3e-4bd8-47bb-a179-a97ce071aa44', '5ca5a73f-1762-47c0-ba19-dc1a5e7d0e69', '9a8467b0-b0f3-4f60-930d-cd1fbe20b598'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:03 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.485s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:03 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:03 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Deleted volume successfully. Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fca4f317-9e15-4d60-8601-b513886c3a3c tempest-VolumesActionsTest-1750140723 None] Lock "cinder-1b7a7b89-6856-42d3-a0fd-4a36ec58faa5-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:04 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:04 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:04 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.294s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Deleted volume successfully. Jul 17 15:33:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f6e17f7a-32a6-4c20-b371-a0617bbbe7d6 tempest-VolumesGetTest-396318636 None] Lock "cinder-46be23ef-6562-499b-8603-a766d57fcf3a-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (537dd118-0ef9-4044-b81f-b94b2c4e0c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c731da08-b57a-412e-9393-9c9e6a28bef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c731da08-b57a-412e-9393-9c9e6a28bef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111425211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c547af1-b101-42ab-8dfc-45d015f665a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:05Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34383ab-bf09-4feb-91bf-51d6c9ecdafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34383ab-bf09-4feb-91bf-51d6c9ecdafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac3ce59-6df9-4136-ac96-de5abf4ed6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac3ce59-6df9-4136-ac96-de5abf4ed6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c547af1-b101-42ab-8dfc-45d015f665a7', 'volume_name': 'volume-3c547af1-b101-42ab-8dfc-45d015f665a7', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f5dca7-0f20-4847-8eb6-1beef3f824cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f5dca7-0f20-4847-8eb6-1beef3f824cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef01f7bc-a60c-4382-a43f-fb5fd07ef832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:05 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Volume 3c547af1-b101-42ab-8dfc-45d015f665a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c547af1-b101-42ab-8dfc-45d015f665a7', 'volume_size': 1} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111425211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c547af1-b101-42ab-8dfc-45d015f665a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:05Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Creating volume 3c547af1-b101-42ab-8dfc-45d015f665a7 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:05 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:05 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7 1073741824 Jul 17 15:33:05 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:05 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7 1073741824" returned: 0 in 0.560s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:05 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7 Jul 17 15:33:05 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:06 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7" returned: 0 in 0.317s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef01f7bc-a60c-4382-a43f-fb5fd07ef832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c547af1-b101-42ab-8dfc-45d015f665a7', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7ad4f6-28da-4c8c-9819-d08898ed97c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:06 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Volume volume-3c547af1-b101-42ab-8dfc-45d015f665a7 (3c547af1-b101-42ab-8dfc-45d015f665a7): created successfully Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7ad4f6-28da-4c8c-9819-d08898ed97c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (537dd118-0ef9-4044-b81f-b94b2c4e0c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fe191b58-a57e-48d3-bcb2-3c068cf36a9e tempest-VolumesActionsTest-1881940488 None] Created volume successfully. Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (9173b9e7-fb8c-42c1-bdf9-0927ca91fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e172a60e-806f-4893-a55d-f87f98f48b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e172a60e-806f-4893-a55d-f87f98f48b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-553577933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cabd0e-e6c5-4eb1-b8a4-269d43ad165a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:06Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a435f63-0f68-4895-966e-2415cc1db637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a435f63-0f68-4895-966e-2415cc1db637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9a0f4c-f89e-43b3-a670-76342cb8d443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.image.glance [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Creating Keystone auth plugin from conf {{(pid=87769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9a0f4c-f89e-43b3-a670-76342cb8d443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13cabd0e-e6c5-4eb1-b8a4-269d43ad165a', 'volume_name': 'volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a53b2f-a0ff-417f-a929-5caa886220c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a53b2f-a0ff-417f-a929-5caa886220c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a6e818-90c8-422d-98a9-920042912c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:07 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Volume 13cabd0e-e6c5-4eb1-b8a4-269d43ad165a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Trying to clone 13cabd0e-e6c5-4eb1-b8a4-269d43ad165a from image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]). {{(pid=87769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 15:33:07 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Image download 20.69 MB at 20.69 MB/s Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e60d1-1cd9-4f5e-a154-aba0cbcd50cb]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Acquiring lock "cinder-3c547af1-b101-42ab-8dfc-45d015f665a7-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Lock "cinder-3c547af1-b101-42ab-8dfc-45d015f665a7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Acquiring lock "cinder-quobyte-3c547af1-b101-42ab-8dfc-45d015f665a7" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Lock "cinder-quobyte-3c547af1-b101-42ab-8dfc-45d015f665a7" acquired by "delete_volume" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:07 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD Jul 17 15:33:07 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74fbd1e-0c99-456c-9f86-b2d4dc182088]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:08 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7 Jul 17 15:33:08 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:08 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Temporary image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 is fetched for user d42f5652c3114ba080013d48006f5915. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a386ef9-7722-4b2f-aced-cdf6dd68d447]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:08 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7" returned: 0 in 0.530s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:08 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7 Jul 17 15:33:08 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:08 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD Jul 17 15:33:08 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:08 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:08 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-553577933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cabd0e-e6c5-4eb1-b8a4-269d43ad165a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:06Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Creating volume 13cabd0e-e6c5-4eb1-b8a4-269d43ad165a {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:08 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3c547af1-b101-42ab-8dfc-45d015f665a7" returned: 0 in 0.419s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Lock "cinder-quobyte-3c547af1-b101-42ab-8dfc-45d015f665a7" released by "delete_volume" :: held 1.040s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:08 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a 1073741824 Jul 17 15:33:08 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:08 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Created reservations ['9bb6bc90-945a-45b5-84f9-d51eeb0a2648', 'bd85be55-de16-4ca8-b070-badbbb27baba', '7327b78d-9dd2-478e-9ddb-fd1f8a1c4cbc', 'e09e3adb-e8e4-447b-82b7-e1975860cf8b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:09 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:09 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:09 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.351s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Deleted volume successfully. Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ff195315-f2df-4b3f-a83a-d738c1ff1baa tempest-VolumesActionsTest-1750140723 None] Lock "cinder-3c547af1-b101-42ab-8dfc-45d015f665a7-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:09 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a 1073741824" returned: 0 in 0.631s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:09 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a Jul 17 15:33:09 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:09 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a" returned: 0 in 0.317s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Attempting download of 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 ((None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}])) to volume 13cabd0e-e6c5-4eb1-b8a4-269d43ad165a. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c71b4c1-73e5-4e54-8e73-f4cefb1e50f3]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_hav7ifmw {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:10 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_hav7ifmw Jul 17 15:33:10 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:10 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_hav7ifmw" returned: 0 in 0.436s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_hav7ifmw {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:10 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_hav7ifmw Jul 17 15:33:10 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (7b2d1cd3-7968-4b48-b4d0-4eb009abc187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63735a38-1aaa-49fd-9e0f-dc49a9c5219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63735a38-1aaa-49fd-9e0f-dc49a9c5219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1276521181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081ff728-99cf-4176-90ff-91906ab43de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:11Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553ccc78-7b78-4299-b35f-21ea4af42c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553ccc78-7b78-4299-b35f-21ea4af42c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0f6de6-d5ba-4ee8-b1b5-213a0c376983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0f6de6-d5ba-4ee8-b1b5-213a0c376983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081ff728-99cf-4176-90ff-91906ab43de3', 'volume_name': 'volume-081ff728-99cf-4176-90ff-91906ab43de3', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8ba32f-60bc-47f0-9c2b-0676149400d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8ba32f-60bc-47f0-9c2b-0676149400d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65e87a9-9959-4201-956a-21773dfe2d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:10 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Volume 081ff728-99cf-4176-90ff-91906ab43de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081ff728-99cf-4176-90ff-91906ab43de3', 'volume_size': 1} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1276521181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081ff728-99cf-4176-90ff-91906ab43de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:11Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Creating volume 081ff728-99cf-4176-90ff-91906ab43de3 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:10 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:10 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_hav7ifmw" returned: 1 in 0.578s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_hav7ifmw' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4ed857-b3de-4873-bb80-99dd503a77f1]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:10 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3 1073741824 Jul 17 15:33:10 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:11 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD Jul 17 15:33:11 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:11 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:11 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 was qcow2, converting to qcow2 {{(pid=87769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 15:33:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:11 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a Jul 17 15:33:11 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:11 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3 1073741824" returned: 0 in 1.027s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:12 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3 Jul 17 15:33:12 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:12 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3" returned: 0 in 0.409s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65e87a9-9959-4201-956a-21773dfe2d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081ff728-99cf-4176-90ff-91906ab43de3', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c62dc29-d5c9-4d04-a3fc-f4c1392d2647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:12 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Volume volume-081ff728-99cf-4176-90ff-91906ab43de3 (081ff728-99cf-4176-90ff-91906ab43de3): created successfully Jul 17 15:33:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c62dc29-d5c9-4d04-a3fc-f4c1392d2647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (7b2d1cd3-7968-4b48-b4d0-4eb009abc187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:12 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9d5a98f6-b45b-4085-a4b3-5b966077ea96 tempest-VolumesActionsTest-1881940488 None] Created volume successfully. Jul 17 15:33:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Acquiring lock "cinder-081ff728-99cf-4176-90ff-91906ab43de3-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Lock "cinder-081ff728-99cf-4176-90ff-91906ab43de3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Acquiring lock "cinder-quobyte-081ff728-99cf-4176-90ff-91906ab43de3" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Lock "cinder-quobyte-081ff728-99cf-4176-90ff-91906ab43de3" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:13 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[42903ac4-7c26-4b87-be9e-1eabe398b562]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:13 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3 Jul 17 15:33:13 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:13 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3" returned: 0 in 0.693s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:13 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3 Jul 17 15:33:13 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:14 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-081ff728-99cf-4176-90ff-91906ab43de3" returned: 0 in 0.405s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Lock "cinder-quobyte-081ff728-99cf-4176-90ff-91906ab43de3" released by "delete_volume" :: held 1.193s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Created reservations ['beb274ae-74a4-4f96-bcab-87f950f9f898', 'e8c9c8ad-f223-4ff6-8b86-7d706ae3231f', '836f48c2-8ae0-4241-8be7-40020a1663f6', '00ef51e3-b101-4db7-ae6f-fd570dd3eeff'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:14 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:14 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:14 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a" returned: 0 in 3.102s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fwjwveqfdevstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:33:14 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Converted 112.00 MB image at 36.04 MB/s Jul 17 15:33:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:14 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a 1G Jul 17 15:33:14 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:15 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.531s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Deleted volume successfully. Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-49dcd472-77d0-4645-8d49-4ac1a1f1d585 tempest-VolumesActionsTest-1750140723 None] Lock "cinder-081ff728-99cf-4176-90ff-91906ab43de3-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:15 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a 1G" returned: 0 in 0.708s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Downloaded image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 ((None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}])) to volume 13cabd0e-e6c5-4eb1-b8a4-269d43ad165a successfully. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Temporary image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 for user d42f5652c3114ba080013d48006f5915 is deleted. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Marking volume 13cabd0e-e6c5-4eb1-b8a4-269d43ad165a as bootable. {{(pid=87769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Copying metadata from image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 to 13cabd0e-e6c5-4eb1-b8a4-269d43ad165a. {{(pid=87769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Creating volume glance metadata for volume 13cabd0e-e6c5-4eb1-b8a4-269d43ad165a backed by image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a6e818-90c8-422d-98a9-920042912c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3285aeb-f936-424e-abca-9cdb162ac2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:15 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Volume volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a (13cabd0e-e6c5-4eb1-b8a4-269d43ad165a): created successfully Jul 17 15:33:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3285aeb-f936-424e-abca-9cdb162ac2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (9173b9e7-fb8c-42c1-bdf9-0927ca91fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d1f24ef8-31d8-45fd-a198-d16536e33a39 tempest-VolumesGetTest-396318636 None] Created volume successfully. Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (10f37676-15f5-4930-9096-567eb14be232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ecf3ac-51c7-4f0c-83a2-2376b08ecf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ecf3ac-51c7-4f0c-83a2-2376b08ecf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-167200533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066f22d4-44e0-48b9-800f-373a5af55d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:17Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ab7abc-72a4-4a36-abc1-84be0fa74ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ab7abc-72a4-4a36-abc1-84be0fa74ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14d54a9-289f-4866-ae79-b523accea811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14d54a9-289f-4866-ae79-b523accea811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066f22d4-44e0-48b9-800f-373a5af55d2e', 'volume_name': 'volume-066f22d4-44e0-48b9-800f-373a5af55d2e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3edc84-3600-40c4-9c69-c09db57b2fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3edc84-3600-40c4-9c69-c09db57b2fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e36a32b-daff-41ac-bae4-b885a440e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:17 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Volume 066f22d4-44e0-48b9-800f-373a5af55d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066f22d4-44e0-48b9-800f-373a5af55d2e', 'volume_size': 1} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-167200533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066f22d4-44e0-48b9-800f-373a5af55d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b115f6ef72c4cdb930d3dd43bd195a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:17Z,use_quota=True,user_id='c8955af1d8f74ebfb08227b4debb71c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Creating volume 066f22d4-44e0-48b9-800f-373a5af55d2e {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:17 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:17 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e 1073741824 Jul 17 15:33:17 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:18 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e 1073741824" returned: 0 in 0.744s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (ec0d3c91-c1bf-450f-b65b-9f3ec2836774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2285cb3a-f91a-4ea4-8b9f-e9dcfff90506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2285cb3a-f91a-4ea4-8b9f-e9dcfff90506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2019630945',display_name='tempest-VolumesGetTest-Volume-1208927920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cb42da-6a4a-4c61-8702-babd4a49aad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:18Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df67f31-4b80-4e05-ae47-c50e747e5479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df67f31-4b80-4e05-ae47-c50e747e5479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85cb49d-7554-48ed-8fb2-d31706ab6868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85cb49d-7554-48ed-8fb2-d31706ab6868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51cb42da-6a4a-4c61-8702-babd4a49aad2', 'volume_name': 'volume-51cb42da-6a4a-4c61-8702-babd4a49aad2', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de5293e-d1a6-4b62-a7b8-94aef19d1aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de5293e-d1a6-4b62-a7b8-94aef19d1aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eae8da8-016c-44bd-9b9f-e978eec8838e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:18 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Volume 51cb42da-6a4a-4c61-8702-babd4a49aad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51cb42da-6a4a-4c61-8702-babd4a49aad2', 'volume_size': 1} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:18 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e Jul 17 15:33:18 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:18 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e" returned: 0 in 0.373s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2019630945',display_name='tempest-VolumesGetTest-Volume-1208927920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cb42da-6a4a-4c61-8702-babd4a49aad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed56678cb20641959d95f41574a66c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:18Z,use_quota=True,user_id='d42f5652c3114ba080013d48006f5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Creating volume 51cb42da-6a4a-4c61-8702-babd4a49aad2 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:18 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e36a32b-daff-41ac-bae4-b885a440e845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066f22d4-44e0-48b9-800f-373a5af55d2e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773567df-97e2-4bfd-8abe-55b9f67cc52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:18 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 1073741824 Jul 17 15:33:18 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:18 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Volume volume-066f22d4-44e0-48b9-800f-373a5af55d2e (066f22d4-44e0-48b9-800f-373a5af55d2e): created successfully Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773567df-97e2-4bfd-8abe-55b9f67cc52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Flow 'volume_create_manager' (10f37676-15f5-4930-9096-567eb14be232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:18 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2e6449a7-a4f5-4a54-9650-a5b94fdf9675 tempest-VolumesActionsTest-1881940488 None] Created volume successfully. Jul 17 15:33:19 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 1073741824" returned: 0 in 0.696s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:19 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 Jul 17 15:33:19 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:19 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2" returned: 0 in 0.524s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eae8da8-016c-44bd-9b9f-e978eec8838e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51cb42da-6a4a-4c61-8702-babd4a49aad2', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75479923-fc73-4eab-a141-4e8f3540c82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:19 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Volume volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 (51cb42da-6a4a-4c61-8702-babd4a49aad2): created successfully Jul 17 15:33:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75479923-fc73-4eab-a141-4e8f3540c82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Flow 'volume_create_manager' (ec0d3c91-c1bf-450f-b65b-9f3ec2836774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:19 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2d6aa3e8-19bb-4418-b5d2-08da33970669 tempest-VolumesGetTest-396318636 None] Created volume successfully. Jul 17 15:33:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Acquiring lock "cinder-066f22d4-44e0-48b9-800f-373a5af55d2e-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Lock "cinder-066f22d4-44e0-48b9-800f-373a5af55d2e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Acquiring lock "cinder-quobyte-066f22d4-44e0-48b9-800f-373a5af55d2e" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Lock "cinder-quobyte-066f22d4-44e0-48b9-800f-373a5af55d2e" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:20 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[96895a82-7c38-42fc-82a8-1c740194b145]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:20 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e Jul 17 15:33:20 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:21 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e" returned: 0 in 0.837s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:21 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e Jul 17 15:33:21 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-51cb42da-6a4a-4c61-8702-babd4a49aad2-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Lock "cinder-51cb42da-6a4a-4c61-8702-babd4a49aad2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-quobyte-51cb42da-6a4a-4c61-8702-babd4a49aad2" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-51cb42da-6a4a-4c61-8702-babd4a49aad2" acquired by "delete_volume" :: waited 0.054s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:21 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-066f22d4-44e0-48b9-800f-373a5af55d2e" returned: 0 in 0.787s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fc41ba-693f-44ee-92ec-1ddb039fcefc]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Lock "cinder-quobyte-066f22d4-44e0-48b9-800f-373a5af55d2e" released by "delete_volume" :: held 1.727s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Created reservations ['45963a19-78fa-4b7b-ac85-e6502ee9ab18', '83d1656c-3d42-4570-a6d4-872dc7b80a52', '01fb4e18-3e97-44da-b5b2-fe143385e891', '6f4c8353-463e-4cb9-96a7-5c30ab2ff57c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:22 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:22 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:22 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 Jul 17 15:33:22 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:22 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.462s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Deleted volume successfully. Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:22 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:22 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b954a0d3-5a1f-470e-aca7-76c46db7631b tempest-VolumesActionsTest-1881940488 None] Lock "cinder-066f22d4-44e0-48b9-800f-373a5af55d2e-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:23 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2" returned: 0 in 1.451s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:23 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2 Jul 17 15:33:23 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:23 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.746s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:33:23 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-51cb42da-6a4a-4c61-8702-babd4a49aad2" returned: 0 in 0.514s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-51cb42da-6a4a-4c61-8702-babd4a49aad2" released by "delete_volume" :: held 2.051s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:23 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Created reservations ['cdb0b9b9-4ba5-48eb-aeb0-f5a2e4786670', '88dc9c20-3c6e-4919-ab94-bd98c9238781', '82281f99-aa51-40c4-9fb2-2aeb23896b42', '1ca09411-3fc0-4234-ba88-c698275fb2f0'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:24 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:24 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Lock "cinder-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:24 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.500s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Deleted volume successfully. Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Acquiring lock "cinder-quobyte-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97b25cd3-262c-48f8-adbe-93f04064e4d8 tempest-VolumesGetTest-396318636 None] Lock "cinder-51cb42da-6a4a-4c61-8702-babd4a49aad2-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a" acquired by "delete_volume" :: waited 0.039s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ad59a2-a5d3-425b-a158-69a8d1a5a0cc]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:24 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a Jul 17 15:33:24 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:25 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a" returned: 0 in 0.737s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:25 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a Jul 17 15:33:25 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:25 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a" returned: 0 in 0.418s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Lock "cinder-quobyte-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a" released by "delete_volume" :: held 1.290s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Created reservations ['0402c98e-98e0-4e8f-b52b-d318a084f4c6', '74c770c8-5b27-4c52-80bd-a3be00d2cf6a', 'd5fa910d-7da8-411e-ac5a-b58e285ef167', '4540490d-ad7f-41ba-8e7b-84c607b7487f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:26 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:26 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:26 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.451s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:26 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Deleted volume successfully. Jul 17 15:33:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-85b9f1db-a01f-4f72-9245-3a94ae7033a9 tempest-VolumesGetTest-396318636 None] Lock "cinder-13cabd0e-e6c5-4eb1-b8a4-269d43ad165a-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:36 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=112,cinder:UPDATE=158,cinder:DELETE=13,cinder:INSERT=36 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:33:36 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:INSERT=44,cinder:SELECT=94,cinder:UPDATE=126,cinder:DELETE=11 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Flow 'volume_create_manager' (ed376670-b806-4614-b651-8acd165d8ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88776158-d887-494c-97fd-5c75332457d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88776158-d887-494c-97fd-5c75332457d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-484927057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bea3f7-bd2b-41a9-9025-dcca32d05e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac9ebac33246d6b7ef6c5c440fc903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:39Z,use_quota=True,user_id='08c12e343e55409c9388f040105e0a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc4d9ec-b382-44a8-b484-2603d68389c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc4d9ec-b382-44a8-b484-2603d68389c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1309ba6-3e63-4a0a-9807-bc9b79c572df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1309ba6-3e63-4a0a-9807-bc9b79c572df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bea3f7-bd2b-41a9-9025-dcca32d05e34', 'volume_name': 'volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6543dc-153a-444e-b5e6-e7041d05ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6543dc-153a-444e-b5e6-e7041d05ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02014e4-ce9f-4750-9640-27a88b60e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:38 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Volume 96bea3f7-bd2b-41a9-9025-dcca32d05e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34', 'volume_size': 1} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-484927057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bea3f7-bd2b-41a9-9025-dcca32d05e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac9ebac33246d6b7ef6c5c440fc903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:39Z,use_quota=True,user_id='08c12e343e55409c9388f040105e0a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Creating volume 96bea3f7-bd2b-41a9-9025-dcca32d05e34 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:38 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:38 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 1073741824 Jul 17 15:33:38 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:39 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 1073741824" returned: 0 in 0.611s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:39 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 Jul 17 15:33:39 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:39 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34" returned: 0 in 0.332s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02014e4-ce9f-4750-9640-27a88b60e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f134a174-654c-4d37-9f91-a14465d5075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:39 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Volume volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 (96bea3f7-bd2b-41a9-9025-dcca32d05e34): created successfully Jul 17 15:33:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f134a174-654c-4d37-9f91-a14465d5075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Flow 'volume_create_manager' (ed376670-b806-4614-b651-8acd165d8ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:39 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4a965a36-2746-4e87-8bfc-c749ee9fec95 tempest-AttachVolumeTestJSON-312816881 None] Created volume successfully. Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Flow 'volume_create_manager' (6c1daeee-30c5-4f0e-a494-fefb0cc33dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f731092f-452c-429a-9994-b672e766bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f731092f-452c-429a-9994-b672e766bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1101844103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebda08aa-d153-4263-8d48-5ad5f9356b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ba34f7864c4dc1b9c93a3788efa37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:40Z,use_quota=True,user_id='a3ab158a69ce42928cb1bfb90b29e12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e9c824-d04b-43ae-ad56-440a1220166c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e9c824-d04b-43ae-ad56-440a1220166c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2200a06-ec38-4532-81e4-718cbf141a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2200a06-ec38-4532-81e4-718cbf141a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebda08aa-d153-4263-8d48-5ad5f9356b91', 'volume_name': 'volume-ebda08aa-d153-4263-8d48-5ad5f9356b91', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81499ffb-2bc4-4417-aed5-a471cc2cf0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81499ffb-2bc4-4417-aed5-a471cc2cf0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b509b030-ecb9-41aa-ac0b-0b0f8052b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:40 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Volume ebda08aa-d153-4263-8d48-5ad5f9356b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebda08aa-d153-4263-8d48-5ad5f9356b91', 'volume_size': 1} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1101844103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebda08aa-d153-4263-8d48-5ad5f9356b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ba34f7864c4dc1b9c93a3788efa37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:40Z,use_quota=True,user_id='a3ab158a69ce42928cb1bfb90b29e12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Creating volume ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:40 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:40 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 1073741824 Jul 17 15:33:40 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:40 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 1073741824" returned: 0 in 0.564s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:40 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 Jul 17 15:33:40 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:41 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91" returned: 0 in 0.364s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b509b030-ecb9-41aa-ac0b-0b0f8052b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebda08aa-d153-4263-8d48-5ad5f9356b91', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd08564e-9c1a-44e0-a2ac-6fea9b4058d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:41 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Volume volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 (ebda08aa-d153-4263-8d48-5ad5f9356b91): created successfully Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd08564e-9c1a-44e0-a2ac-6fea9b4058d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Flow 'volume_create_manager' (6c1daeee-30c5-4f0e-a494-fefb0cc33dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:41 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6d4da0b2-d57d-4ab6-b432-894bf330b609 tempest-VolumesDeleteCascade-1139181936 None] Created volume successfully. Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-d19b83e1-07f8-485f-ba89-c5dcbb4e51ff req-0e6e4999-8bb1-40ed-90b9-da8d21966171 tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-d19b83e1-07f8-485f-ba89-c5dcbb4e51ff req-0e6e4999-8bb1-40ed-90b9-da8d21966171 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-d19b83e1-07f8-485f-ba89-c5dcbb4e51ff req-0e6e4999-8bb1-40ed-90b9-da8d21966171 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-d19b83e1-07f8-485f-ba89-c5dcbb4e51ff req-0e6e4999-8bb1-40ed-90b9-da8d21966171 tempest-AttachVolumeTestJSON-312816881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62359bfa-29bf-435d-99be-7eb37e0bd2de', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:33:41 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-d19b83e1-07f8-485f-ba89-c5dcbb4e51ff req-0e6e4999-8bb1-40ed-90b9-da8d21966171 tempest-AttachVolumeTestJSON-312816881 None] attachment_update completed successfully. Jul 17 15:33:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Creating offline snapshot 0be771e8-0509-47bd-9659-f5ab378c3a45 of volume ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:33:42 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8defaae-5600-4b99-8414-0cbd8efae865]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:42 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 Jul 17 15:33:42 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:42 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91" returned: 0 in 0.393s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:43 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 1G Jul 17 15:33:43 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:43 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 1G" returned: 0 in 0.487s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:43 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 Jul 17 15:33:43 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:43 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45" returned: 0 in 0.385s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:43 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 is being set with open permissions: ugo+rw Jul 17 15:33:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:43 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 Jul 17 15:33:43 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:44 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45" returned: 0 in 0.323s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:44 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.info Jul 17 15:33:44 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:44 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.info" returned: 0 in 0.533s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:44 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.info is being set with open permissions: ugo+rw Jul 17 15:33:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:44 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.info Jul 17 15:33:44 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:44 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Flow 'volume_create_manager' (cc497125-3699-40e6-8589-7f8e1b4bb89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8427e2e9-dee9-4e72-bd4a-95e32ccb1418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8427e2e9-dee9-4e72-bd4a-95e32ccb1418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1193859826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcaacb4c-f5bc-46f5-87f2-99057913bf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac9ebac33246d6b7ef6c5c440fc903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:45Z,use_quota=True,user_id='08c12e343e55409c9388f040105e0a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99bdd1e-8fc8-4033-b04a-b700a5cdad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99bdd1e-8fc8-4033-b04a-b700a5cdad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6a591a-018b-47e8-b5f3-885187a36a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6a591a-018b-47e8-b5f3-885187a36a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcaacb4c-f5bc-46f5-87f2-99057913bf94', 'volume_name': 'volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffe6c45-be87-45f4-96d6-a25efe78529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffe6c45-be87-45f4-96d6-a25efe78529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecab2f6-cd42-47e2-bc16-b023c3006b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Volume bcaacb4c-f5bc-46f5-87f2-99057913bf94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94', 'volume_size': 1} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:45 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.info" returned: 0 in 0.427s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.171s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1193859826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcaacb4c-f5bc-46f5-87f2-99057913bf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac9ebac33246d6b7ef6c5c440fc903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:45Z,use_quota=True,user_id='08c12e343e55409c9388f040105e0a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Creating volume bcaacb4c-f5bc-46f5-87f2-99057913bf94 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:45 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:45 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 1073741824 Jul 17 15:33:45 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e677f7b4-89b9-4ddf-81c9-52d8dc1ffd22 tempest-VolumesDeleteCascade-1139181936 None] Create snapshot completed successfully Jul 17 15:33:45 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 1073741824" returned: 0 in 0.634s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:46 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 Jul 17 15:33:46 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:46 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94" returned: 0 in 0.313s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.345s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecab2f6-cd42-47e2-bc16-b023c3006b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f511edc-9921-46b0-ab93-846ea325c583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Creating offline snapshot 2367b7ab-bf74-4293-98be-eb8bb704d262 of volume ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:33:46 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Volume volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 (bcaacb4c-f5bc-46f5-87f2-99057913bf94): created successfully Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f511edc-9921-46b0-ab93-846ea325c583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Flow 'volume_create_manager' (cc497125-3699-40e6-8589-7f8e1b4bb89e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a6e81-c183-4780-a83f-e675960ba04c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:46 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-133a093c-f80e-4715-a18f-730589de454f tempest-AttachVolumeTestJSON-312816881 None] Created volume successfully. Jul 17 15:33:46 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 Jul 17 15:33:46 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:46 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45" returned: 0 in 0.453s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebda08aa-d153-4263-8d48-5ad5f9356b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:33:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:46 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 1G Jul 17 15:33:46 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:47 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 1G" returned: 0 in 0.639s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:47 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 Jul 17 15:33:47 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:47 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262" returned: 0 in 0.371s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:47 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 is being set with open permissions: ugo+rw Jul 17 15:33:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:47 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 Jul 17 15:33:47 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-76ae317e-6e73-4d7b-9ed3-5e44d81910cb req-a8a6aa17-bec5-4491-ae39-7b6ef212c9ba tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:48 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262" returned: 0 in 0.269s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-76ae317e-6e73-4d7b-9ed3-5e44d81910cb req-a8a6aa17-bec5-4491-ae39-7b6ef212c9ba tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.135s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-76ae317e-6e73-4d7b-9ed3-5e44d81910cb req-a8a6aa17-bec5-4491-ae39-7b6ef212c9ba tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-539e2cff-90a0-4095-be56-c5b70e64ae95 tempest-VolumesDeleteCascade-1139181936 None] Create snapshot completed successfully Jul 17 15:33:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-76ae317e-6e73-4d7b-9ed3-5e44d81910cb req-a8a6aa17-bec5-4491-ae39-7b6ef212c9ba tempest-AttachVolumeTestJSON-312816881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '566d978d-7e02-4f3b-ac05-f0cfdea64983', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:33:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-76ae317e-6e73-4d7b-9ed3-5e44d81910cb req-a8a6aa17-bec5-4491-ae39-7b6ef212c9ba tempest-AttachVolumeTestJSON-312816881 None] attachment_update completed successfully. Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-ebda08aa-d153-4263-8d48-5ad5f9356b91-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-ebda08aa-d153-4263-8d48-5ad5f9356b91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Performing cascade delete. {{(pid=87769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-0be771e8-0509-47bd-9659-f5ab378c3a45-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-0be771e8-0509-47bd-9659-f5ab378c3a45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-ebda08aa-d153-4263-8d48-5ad5f9356b91" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-ebda08aa-d153-4263-8d48-5ad5f9356b91" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-0be771e8-0509-47bd-9659-f5ab378c3a45" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-0be771e8-0509-47bd-9659-f5ab378c3a45" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Deleting offline snapshot 0be771e8-0509-47bd-9659-f5ab378c3a45 of volume ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] snapshot_file for this snap is: volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1dd918-f84d-454f-aae4-7dd72881fef3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:49 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 Jul 17 15:33:49 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Flow 'volume_create_manager' (74832969-9fb3-4a3e-828b-1b99e6c0f95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ed7167-dfe5-49d7-a123-72547795323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ed7167-dfe5-49d7-a123-72547795323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-486707203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa481beb-6f40-427d-9cbd-8e103421188a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7232972cc93d42b98b36b1973d76ef05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:50Z,use_quota=True,user_id='7b5db4a19610426fb43fd8b842675ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01722216-369e-44d2-b0a8-ba9ae36122bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01722216-369e-44d2-b0a8-ba9ae36122bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3198e3-06e8-49f4-918a-7eb66ed17547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3198e3-06e8-49f4-918a-7eb66ed17547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa481beb-6f40-427d-9cbd-8e103421188a', 'volume_name': 'volume-aa481beb-6f40-427d-9cbd-8e103421188a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a3a218-0cc4-4aec-a6fb-f88a26ea07c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a3a218-0cc4-4aec-a6fb-f88a26ea07c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58b1571-a48a-4daf-bd23-abe3b47c24f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Volume aa481beb-6f40-427d-9cbd-8e103421188a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa481beb-6f40-427d-9cbd-8e103421188a', 'volume_size': 1} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-486707203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa481beb-6f40-427d-9cbd-8e103421188a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7232972cc93d42b98b36b1973d76ef05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:50Z,use_quota=True,user_id='7b5db4a19610426fb43fd8b842675ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Creating volume aa481beb-6f40-427d-9cbd-8e103421188a {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:50 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:50 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45" returned: 0 in 0.556s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebda08aa-d153-4263-8d48-5ad5f9356b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:33:50 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a 1073741824 Jul 17 15:33:50 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3221dac4-ee0f-44ce-b4f2-613c65965a4e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:50 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-369d4821-39a9-4ace-b727-1f0101cbc43a req-b966cd07-025c-4574-8894-ea52a3e84a1c tempest-AttachVolumeTestJSON-312816881 None] Terminate volume connection completed successfully. Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-369d4821-39a9-4ace-b727-1f0101cbc43a req-b966cd07-025c-4574-8894-ea52a3e84a1c tempest-AttachVolumeTestJSON-312816881 None] Deleting attachment 62359bfa-29bf-435d-99be-7eb37e0bd2de. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:33:50 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 Jul 17 15:33:50 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:50 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91" returned: 0 in 0.434s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0975068-052c-4456-9e35-bf1f6bd8a15a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:50 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a 1073741824" returned: 0 in 0.566s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:50 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a Jul 17 15:33:50 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:50 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 Jul 17 15:33:50 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:50 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a" returned: 0 in 0.313s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58b1571-a48a-4daf-bd23-abe3b47c24f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa481beb-6f40-427d-9cbd-8e103421188a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae0514e-d2a2-4ad6-9f2d-69e1c14218d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:51 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Volume volume-aa481beb-6f40-427d-9cbd-8e103421188a (aa481beb-6f40-427d-9cbd-8e103421188a): created successfully Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae0514e-d2a2-4ad6-9f2d-69e1c14218d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Flow 'volume_create_manager' (74832969-9fb3-4a3e-828b-1b99e6c0f95e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262" returned: 0 in 0.430s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebda08aa-d153-4263-8d48-5ad5f9356b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[88be382b-36a6-4928-836c-0fe2faf333d7]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:51 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9e8db065-9dc6-4eed-b6ff-47fbc4889210 tempest-AttachVolumeNegativeTest-857928603 None] Created volume successfully. Jul 17 15:33:51 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 Jul 17 15:33:51 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:51 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45" returned: 0 in 0.625s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebda08aa-d153-4263-8d48-5ad5f9356b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05e6380-e899-4939-a6d4-4e7c25d4ba16]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:51 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 Jul 17 15:33:51 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:51 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-65c12960-92e6-4d71-bf6a-b201506c98f4 req-11221945-62f5-4913-bd5c-248f8484fec8 tempest-AttachVolumeTestJSON-312816881 None] Terminate volume connection completed successfully. Jul 17 15:33:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-65c12960-92e6-4d71-bf6a-b201506c98f4 req-11221945-62f5-4913-bd5c-248f8484fec8 tempest-AttachVolumeTestJSON-312816881 None] Deleting attachment 566d978d-7e02-4f3b-ac05-f0cfdea64983. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:33:52 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91" returned: 0 in 0.588s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:52 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 Jul 17 15:33:52 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e3f9bc85-bf92-4d9d-ac4c-75e13b5f7f6a req-366605b0-0ef4-42f2-83a5-1cf9bb0d9ef9 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e3f9bc85-bf92-4d9d-ac4c-75e13b5f7f6a req-366605b0-0ef4-42f2-83a5-1cf9bb0d9ef9 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e3f9bc85-bf92-4d9d-ac4c-75e13b5f7f6a req-366605b0-0ef4-42f2-83a5-1cf9bb0d9ef9 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:52 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45" returned: 0 in 0.610s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:52 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45 Jul 17 15:33:52 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e3f9bc85-bf92-4d9d-ac4c-75e13b5f7f6a req-366605b0-0ef4-42f2-83a5-1cf9bb0d9ef9 tempest-AttachVolumeNegativeTest-857928603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-aa481beb-6f40-427d-9cbd-8e103421188a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afc5fb0d-fa3b-4808-b620-917bb2a300ec', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:33:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-e3f9bc85-bf92-4d9d-ac4c-75e13b5f7f6a req-366605b0-0ef4-42f2-83a5-1cf9bb0d9ef9 tempest-AttachVolumeNegativeTest-857928603 None] attachment_update completed successfully. Jul 17 15:33:53 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.0be771e8-0509-47bd-9659-f5ab378c3a45" returned: 0 in 0.383s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 -F qcow2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:53 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 -F qcow2 Jul 17 15:33:53 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:53 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 -F qcow2" returned: 0 in 0.620s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-0be771e8-0509-47bd-9659-f5ab378c3a45" released by "_delete_snapshot" :: held 4.564s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-ebda08aa-d153-4263-8d48-5ad5f9356b91" released by "delete_snapshot" :: held 4.611s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:54 devstack cinder-volume[87769]: WARNING cinder.quota [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Created reservations ['0641a8ae-6027-48d3-b9df-ced762ddb467', 'f3e008c0-9992-4103-904a-85208cc18b60', '1786210a-0c6c-451d-a55b-9629639d28dd', 'b103ac4a-a26d-4d57-b83a-7cdd5161ef34'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Delete snapshot completed successfully. Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-0be771e8-0509-47bd-9659-f5ab378c3a45-delete_snapshot" released by "delete_snapshot" :: held 4.866s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-2367b7ab-bf74-4293-98be-eb8bb704d262-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-2367b7ab-bf74-4293-98be-eb8bb704d262-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-ebda08aa-d153-4263-8d48-5ad5f9356b91" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-ebda08aa-d153-4263-8d48-5ad5f9356b91" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-2367b7ab-bf74-4293-98be-eb8bb704d262" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-2367b7ab-bf74-4293-98be-eb8bb704d262" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Deleting offline snapshot 2367b7ab-bf74-4293-98be-eb8bb704d262 of volume ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] snapshot_file for this snap is: volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c88c48-2028-489d-9d82-005ace1b7b01]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:54 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 Jul 17 15:33:54 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:54 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262" returned: 0 in 0.499s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebda08aa-d153-4263-8d48-5ad5f9356b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[77637285-1100-4c59-a3ee-7f29e1ea68b4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:55 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 Jul 17 15:33:55 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:55 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91" returned: 0 in 0.675s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:55 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 Jul 17 15:33:55 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:56 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262" returned: 0 in 0.477s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:56 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262 Jul 17 15:33:56 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-cebf5398-7048-420d-915b-23e021ecd3b5 req-e734ece2-aeb6-45b2-aa5e-f7578850d6e8 tempest-AttachVolumeNegativeTest-857928603 None] Terminate volume connection completed successfully. Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-cebf5398-7048-420d-915b-23e021ecd3b5 req-e734ece2-aeb6-45b2-aa5e-f7578850d6e8 tempest-AttachVolumeNegativeTest-857928603 None] Deleting attachment afc5fb0d-fa3b-4808-b620-917bb2a300ec. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:33:56 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91.2367b7ab-bf74-4293-98be-eb8bb704d262" returned: 0 in 0.376s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-2367b7ab-bf74-4293-98be-eb8bb704d262" released by "_delete_snapshot" :: held 2.185s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-ebda08aa-d153-4263-8d48-5ad5f9356b91" released by "delete_snapshot" :: held 2.227s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Created reservations ['41f3e867-db19-46c9-acd9-8f4b113ea168', '201fc18d-fb94-4a31-93b8-9a64cbec0d97', '6c47f6c4-419c-44cd-b4e9-85595a1fcd1b', 'ba95c7cb-08bd-4c3c-b9c2-4fb56d275bcc'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Delete snapshot completed successfully. Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-2367b7ab-bf74-4293-98be-eb8bb704d262-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Snapshots deleted, issuing volume delete {{(pid=87769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-ebda08aa-d153-4263-8d48-5ad5f9356b91" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-ebda08aa-d153-4263-8d48-5ad5f9356b91" acquired by "delete_volume" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c62a0-0448-46b4-8a5e-770b2b955871]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:56 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 Jul 17 15:33:57 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:57 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91" returned: 0 in 0.563s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:57 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91 Jul 17 15:33:57 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:57 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ebda08aa-d153-4263-8d48-5ad5f9356b91" returned: 0 in 0.468s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-ebda08aa-d153-4263-8d48-5ad5f9356b91" released by "delete_volume" :: held 1.153s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:57 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Created reservations ['07b9f7b0-38cd-4eb1-bdb1-786f2a5ec901', '254452e9-1fed-4f26-a9ae-58f02207b715', '7721f3e3-29d5-42ff-b526-d5abad56a94e', 'af79b00c-c6d8-44d9-b929-555d83f0e679'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:58 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:58 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "cinder-bcaacb4c-f5bc-46f5-87f2-99057913bf94-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-bcaacb4c-f5bc-46f5-87f2-99057913bf94-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "cinder-quobyte-bcaacb4c-f5bc-46f5-87f2-99057913bf94" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-quobyte-bcaacb4c-f5bc-46f5-87f2-99057913bf94" acquired by "delete_volume" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b3bbc-d8f8-4a8d-b6d9-920198a83a12]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:58 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.375s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:33:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Deleted volume successfully. Jul 17 15:33:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9152320-3e14-4f64-a291-ec109ad82693 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-ebda08aa-d153-4263-8d48-5ad5f9356b91-delete_volume" released by "delete_volume" :: held 9.285s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:58 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 Jul 17 15:33:58 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:59 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94" returned: 0 in 0.678s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:59 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94 Jul 17 15:33:59 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Flow 'volume_create_manager' (e78f3bd0-616b-4720-8a59-fb95a5c64a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d12c35-3b19-49e1-958f-ac537c466eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d12c35-3b19-49e1-958f-ac537c466eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1722762778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4788f52f-8cfd-4468-b8c7-9deb8308ebed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ba34f7864c4dc1b9c93a3788efa37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:59Z,use_quota=True,user_id='a3ab158a69ce42928cb1bfb90b29e12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa629ac-c28a-4a8e-8c50-1435c2695f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa629ac-c28a-4a8e-8c50-1435c2695f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dba4e66-8992-41f5-80fa-40b04d542bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dba4e66-8992-41f5-80fa-40b04d542bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4788f52f-8cfd-4468-b8c7-9deb8308ebed', 'volume_name': 'volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d01be0-4475-4d8b-84f0-e84073ba71d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d01be0-4475-4d8b-84f0-e84073ba71d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666f92f1-2c53-4cba-8b91-45d55e42a44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:33:59 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Volume 4788f52f-8cfd-4468-b8c7-9deb8308ebed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed', 'volume_size': 1} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1722762778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4788f52f-8cfd-4468-b8c7-9deb8308ebed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ba34f7864c4dc1b9c93a3788efa37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:33:59Z,use_quota=True,user_id='a3ab158a69ce42928cb1bfb90b29e12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Creating volume 4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:33:59 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:59 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed 1073741824 Jul 17 15:33:59 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:33:59 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bcaacb4c-f5bc-46f5-87f2-99057913bf94" returned: 0 in 0.461s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-quobyte-bcaacb4c-f5bc-46f5-87f2-99057913bf94" released by "delete_volume" :: held 1.224s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Created reservations ['0ddb87fb-73ff-4a8f-a95a-277f0e39c5b6', '65210299-eb49-42f7-bd36-e1e19de3a4bf', '943a462c-600c-4086-aca9-82bb0f9507e3', '5aee8948-37bc-4138-918f-26b7be02a011'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:33:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:33:59 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:33:59 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:00 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed 1073741824" returned: 0 in 0.783s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:00 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.356s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:00 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed Jul 17 15:34:00 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Deleted volume successfully. Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6cbbdaf1-c7f9-45c5-b44e-655fd425988e tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-bcaacb4c-f5bc-46f5-87f2-99057913bf94-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:00 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed" returned: 0 in 0.322s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666f92f1-2c53-4cba-8b91-45d55e42a44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7643b6f-1f15-4c41-95eb-59e855c61757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:00 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Volume volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed (4788f52f-8cfd-4468-b8c7-9deb8308ebed): created successfully Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7643b6f-1f15-4c41-95eb-59e855c61757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Flow 'volume_create_manager' (e78f3bd0-616b-4720-8a59-fb95a5c64a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "cinder-96bea3f7-bd2b-41a9-9025-dcca32d05e34-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6b5770da-1b5a-4de2-8eb0-f1401caf7229 tempest-VolumesDeleteCascade-1139181936 None] Created volume successfully. Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-96bea3f7-bd2b-41a9-9025-dcca32d05e34-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "cinder-quobyte-96bea3f7-bd2b-41a9-9025-dcca32d05e34" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-quobyte-96bea3f7-bd2b-41a9-9025-dcca32d05e34" acquired by "delete_volume" :: waited 0.038s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c799be48-c74d-4a43-9061-d9e1b81ee3b6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:00 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 Jul 17 15:34:00 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:01 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34" returned: 0 in 0.546s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:01 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34 Jul 17 15:34:01 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Creating offline snapshot 9dd2e64c-3774-4789-aac6-744b19d7616b of volume 4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a4e35d-e5f3-4f26-8833-78ac49186cb4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:01 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed Jul 17 15:34:01 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:01 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-96bea3f7-bd2b-41a9-9025-dcca32d05e34" returned: 0 in 0.455s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-quobyte-96bea3f7-bd2b-41a9-9025-dcca32d05e34" released by "delete_volume" :: held 1.071s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Created reservations ['10e46082-ac45-4c3b-ac9d-2e0e6e4e6686', 'cb4a7da8-aefd-4cff-8162-b652d78c8c13', '0e681ce9-fb97-43d8-9560-e86323a5fbb5', '94025c91-cf5f-4e69-971f-851b592b5d41'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:01 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:01 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:02 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed" returned: 0 in 0.438s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:02 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b 1G Jul 17 15:34:02 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:02 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.283s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:02 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Deleted volume successfully. Jul 17 15:34:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fba9bc1-deba-41a0-96b6-4e8eaa4a9b4e tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-96bea3f7-bd2b-41a9-9025-dcca32d05e34-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:02 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b 1G" returned: 0 in 0.433s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:02 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b Jul 17 15:34:02 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:02 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b" returned: 0 in 0.337s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:02 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b is being set with open permissions: ugo+rw Jul 17 15:34:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:02 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b Jul 17 15:34:02 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "cinder-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "cinder-quobyte-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-quobyte-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8891bf-6de6-4855-a988-6dfa601ed63b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:03 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b" returned: 0 in 0.382s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:03 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.info Jul 17 15:34:03 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:03 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 Jul 17 15:34:03 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:03 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.info" returned: 0 in 0.361s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:03 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.info is being set with open permissions: ugo+rw Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:03 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36" returned: 0 in 0.463s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:03 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.info Jul 17 15:34:03 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:03 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36 Jul 17 15:34:03 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:03 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.info" returned: 0 in 0.320s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:03 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36" returned: 0 in 0.345s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:03 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b6f5b331-846c-47c9-9f6c-29d7ca6f3d00 tempest-VolumesDeleteCascade-1139181936 None] Create snapshot completed successfully Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-quobyte-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36" released by "delete_volume" :: held 0.880s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Created reservations ['8a193fc0-c209-49d1-b2fb-d7b17a42d4bc', '58f7aafd-ebe0-483e-9bf7-c1f528784401', '31c93a91-0af8-4c8c-9304-f6b51e3fb2b0', '7e04a150-e62a-42a1-b7d2-665dd5ea4bf4'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:04 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:04 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:04 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.320s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Deleted volume successfully. Jul 17 15:34:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-96f302ac-a692-4f00-9d07-c06235b3e514 tempest-AttachVolumeTestJSON-312816881 None] Lock "cinder-d943bd8f-d1be-4ee8-829a-86a0b8fbeb36-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Flow 'volume_create_manager' (c2f4ab47-fafe-4187-b078-2b68c4a7dd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2a2141-8079-427e-84bd-6fa8ed93db59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2a2141-8079-427e-84bd-6fa8ed93db59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1764080721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d809a62-63a8-4d78-b657-09e6ba85f1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af6120e0ef344c88868fa978598308a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:05Z,use_quota=True,user_id='4ffa4874efc44fa990abfcc553b5f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edaff205-57f2-409f-91cf-0866dd3ee56c),volume_type_id=edaff205-57f2-409f-91cf-0866dd3ee56c)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16062347-8370-4bb8-abb6-4f27451a5535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16062347-8370-4bb8-abb6-4f27451a5535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996dc757-dfbd-4710-9e1d-2be4fd885a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996dc757-dfbd-4710-9e1d-2be4fd885a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d809a62-63a8-4d78-b657-09e6ba85f1db', 'volume_name': 'volume-3d809a62-63a8-4d78-b657-09e6ba85f1db', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4cc5a3-0a52-4102-b908-633c371ba66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4cc5a3-0a52-4102-b908-633c371ba66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dee4fa6-50ab-42ad-a4cd-e837331630fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Volume 3d809a62-63a8-4d78-b657-09e6ba85f1db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d809a62-63a8-4d78-b657-09e6ba85f1db', 'volume_size': 1} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1764080721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d809a62-63a8-4d78-b657-09e6ba85f1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af6120e0ef344c88868fa978598308a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:05Z,use_quota=True,user_id='4ffa4874efc44fa990abfcc553b5f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edaff205-57f2-409f-91cf-0866dd3ee56c),volume_type_id=edaff205-57f2-409f-91cf-0866dd3ee56c)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Creating volume 3d809a62-63a8-4d78-b657-09e6ba85f1db {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:05 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:05 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db 1073741824 Jul 17 15:34:05 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Flow 'volume_create_manager' (74bc27d6-3c6e-4931-ae58-f0d2d53b24ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60865765-2285-4b4c-9e82-9965fb23689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60865765-2285-4b4c-9e82-9965fb23689a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1461874311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942d242d-3003-4fb8-baea-14aaf2a8b100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ba34f7864c4dc1b9c93a3788efa37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9dd2e64c-3774-4789-aac6-744b19d7616b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:06Z,use_quota=True,user_id='a3ab158a69ce42928cb1bfb90b29e12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c6b296-0340-44ee-9cf3-c208f9aeeae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c6b296-0340-44ee-9cf3-c208f9aeeae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c643d66-c20d-45ff-96bf-959b10e3185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c643d66-c20d-45ff-96bf-959b10e3185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '942d242d-3003-4fb8-baea-14aaf2a8b100', 'volume_name': 'volume-942d242d-3003-4fb8-baea-14aaf2a8b100', 'volume_size': 1, 'snapshot_id': '9dd2e64c-3774-4789-aac6-744b19d7616b'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa03f043-ca67-4405-a778-a1aff0049f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa03f043-ca67-4405-a778-a1aff0049f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8644820-a4e5-478b-8533-525ba751261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Volume 942d242d-3003-4fb8-baea-14aaf2a8b100: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-942d242d-3003-4fb8-baea-14aaf2a8b100', 'volume_size': 1, 'snapshot_id': '9dd2e64c-3774-4789-aac6-744b19d7616b'} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Flow 'volume_create_manager' (1aac645f-0511-4f3b-91ed-8aed47258bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b5cf29-1aa1-4e4a-a2cd-1db44987739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b5cf29-1aa1-4e4a-a2cd-1db44987739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-507959643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad386c3b-8af9-42d5-a883-11b47384ea49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af6120e0ef344c88868fa978598308a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:06Z,use_quota=True,user_id='4ffa4874efc44fa990abfcc553b5f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(990f2da6-f2de-478a-bc95-3dc5b7ddac20),volume_type_id=990f2da6-f2de-478a-bc95-3dc5b7ddac20)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68307a89-4bb7-4c2c-85be-b5ceeab17163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68307a89-4bb7-4c2c-85be-b5ceeab17163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4a069c-5b00-421a-af28-c664943ef663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4a069c-5b00-421a-af28-c664943ef663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad386c3b-8af9-42d5-a883-11b47384ea49', 'volume_name': 'volume-ad386c3b-8af9-42d5-a883-11b47384ea49', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5dbaa85-b1d3-473d-bf3c-c513a71aadfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5dbaa85-b1d3-473d-bf3c-c513a71aadfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a0ccf3-bdb4-4e85-b3eb-87fa8cd98478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:06 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Volume ad386c3b-8af9-42d5-a883-11b47384ea49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad386c3b-8af9-42d5-a883-11b47384ea49', 'volume_size': 1} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:06 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db 1073741824" returned: 0 in 0.828s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:06 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db Jul 17 15:34:06 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:06 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db" returned: 0 in 0.318s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.627s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-9dd2e64c-3774-4789-aac6-744b19d7616b-942d242d-3003-4fb8-baea-14aaf2a8b100" by "_create_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dee4fa6-50ab-42ad-a4cd-e837331630fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d809a62-63a8-4d78-b657-09e6ba85f1db', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3124da4e-bcf7-413a-870e-5a630e00a46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-9dd2e64c-3774-4789-aac6-744b19d7616b-942d242d-3003-4fb8-baea-14aaf2a8b100" acquired by "_create_volume_from_snapshot" :: waited 0.071s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Creating volume 942d242d-3003-4fb8-baea-14aaf2a8b100 from snapshot 9dd2e64c-3774-4789-aac6-744b19d7616b {{(pid=87769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-942d242d-3003-4fb8-baea-14aaf2a8b100" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:06 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Volume volume-3d809a62-63a8-4d78-b657-09e6ba85f1db (3d809a62-63a8-4d78-b657-09e6ba85f1db): created successfully Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3124da4e-bcf7-413a-870e-5a630e00a46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Flow 'volume_create_manager' (c2f4ab47-fafe-4187-b078-2b68c4a7dd06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-942d242d-3003-4fb8-baea-14aaf2a8b100" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] snapshot: 9dd2e64c-3774-4789-aac6-744b19d7616b, volume: 942d242d-3003-4fb8-baea-14aaf2a8b100, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:34:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-94b88620-0a7d-4785-8471-4d19629a904a tempest-TestInstancesWithCinderVolumes-1768919279 None] Created volume successfully. Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6a7136-424f-47bd-9705-337a9d73305e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:06 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b Jul 17 15:34:06 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:06 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Flow 'volume_create_manager' (e54c7f05-6b41-4133-a763-4b44c04658dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572ca082-979d-4780-863e-a36550e1679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572ca082-979d-4780-863e-a36550e1679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-894595993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452bcccd-6a7a-4c34-b354-d1b1eb3791c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af6120e0ef344c88868fa978598308a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:07Z,use_quota=True,user_id='4ffa4874efc44fa990abfcc553b5f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e0a41e-51b5-4dad-b587-fea42d87345f),volume_type_id=03e0a41e-51b5-4dad-b587-fea42d87345f)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7f400d-e720-4c0c-95a9-7ed871bb4353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7f400d-e720-4c0c-95a9-7ed871bb4353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cbafca-089c-4664-9bd5-ad76ae9f9af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.image.glance [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Creating Keystone auth plugin from conf {{(pid=87769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 15:34:07 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b" returned: 0 in 0.482s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c5d9a7-e5eb-495d-8e40-4a3cf053abe2]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:07 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed Jul 17 15:34:07 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cbafca-089c-4664-9bd5-ad76ae9f9af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '452bcccd-6a7a-4c34-b354-d1b1eb3791c9', 'volume_name': 'volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9', 'volume_size': 1, 'image_id': '879429b6-c089-415c-b8c8-eba20819e6cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/879429b6-c089-415c-b8c8-eba20819e6cf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1692631523', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2af6120e0ef344c88868fa978598308a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '879429b6-c089-415c-b8c8-eba20819e6cf', 'created_at': datetime.datetime(2026, 7, 17, 13, 34, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 34, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/879429b6-c089-415c-b8c8-eba20819e6cf/file', 'properties': {}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4edea4-0b97-4189-98b0-aad969b7b9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4edea4-0b97-4189-98b0-aad969b7b9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73c94e2-91bd-421c-8066-1541119fa172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:07 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Volume 452bcccd-6a7a-4c34-b354-d1b1eb3791c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9', 'volume_size': 1, 'image_id': '879429b6-c089-415c-b8c8-eba20819e6cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/879429b6-c089-415c-b8c8-eba20819e6cf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1692631523', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2af6120e0ef344c88868fa978598308a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '879429b6-c089-415c-b8c8-eba20819e6cf', 'created_at': datetime.datetime(2026, 7, 17, 13, 34, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 34, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/879429b6-c089-415c-b8c8-eba20819e6cf/file', 'properties': {}}, 'image_service': } Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Trying to clone 452bcccd-6a7a-4c34-b354-d1b1eb3791c9 from image 879429b6-c089-415c-b8c8-eba20819e6cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/879429b6-c089-415c-b8c8-eba20819e6cf', 'metadata': {}}]). {{(pid=87769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 15:34:07 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed" returned: 0 in 0.616s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:34:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:07 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 Jul 17 15:34:07 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:14 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100" returned: 0 in 6.870s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:14 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab40b01-83c3-4d45-93f1-f3f04f206a28]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:14 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed Jul 17 15:34:14 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD, size 20.69 MB, duration 7.77 sec {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 15:34:15 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Image download 20.69 MB at 2.66 MB/s Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[721e9649-5c41-44bf-9576-79d8db39f4c2]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:15 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed" returned: 0 in 0.682s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:34:15 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Converted 1024.00 MB image at 149.01 MB/s Jul 17 15:34:15 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 is being set with open permissions: ugo+rw Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:15 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD Jul 17 15:34:15 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:15 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 Jul 17 15:34:15 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:15 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Temporary image 879429b6-c089-415c-b8c8-eba20819e6cf is fetched for user 4ffa4874efc44fa990abfcc553b5f4a5. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 15:34:15 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-942d242d-3003-4fb8-baea-14aaf2a8b100" released by "_copy_volume_from_snapshot" :: held 9.101s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-9dd2e64c-3774-4789-aac6-744b19d7616b-942d242d-3003-4fb8-baea-14aaf2a8b100" released by "_create_volume_from_snapshot" :: held 9.183s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.258s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.677s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-507959643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad386c3b-8af9-42d5-a883-11b47384ea49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af6120e0ef344c88868fa978598308a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:06Z,use_quota=True,user_id='4ffa4874efc44fa990abfcc553b5f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(990f2da6-f2de-478a-bc95-3dc5b7ddac20),volume_type_id=990f2da6-f2de-478a-bc95-3dc5b7ddac20)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Creating volume ad386c3b-8af9-42d5-a883-11b47384ea49 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:15 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:15 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49 1073741824 Jul 17 15:34:15 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8644820-a4e5-478b-8533-525ba751261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942d242d-3003-4fb8-baea-14aaf2a8b100', 'volume_size': 1, 'snapshot_id': '9dd2e64c-3774-4789-aac6-744b19d7616b'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18b3208-881b-4d4d-8ba4-51679229e698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:15 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Volume volume-942d242d-3003-4fb8-baea-14aaf2a8b100 (942d242d-3003-4fb8-baea-14aaf2a8b100): created successfully Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18b3208-881b-4d4d-8ba4-51679229e698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Flow 'volume_create_manager' (74bc27d6-3c6e-4931-ae58-f0d2d53b24ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d328c09-8cc3-41c7-a854-edaa47c49eda]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-16c9d31b-2d15-420e-9ceb-175acdf606f8 tempest-VolumesDeleteCascade-1139181936 None] Created volume successfully. Jul 17 15:34:16 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD Jul 17 15:34:16 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:16 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49 1073741824" returned: 0 in 0.634s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:16 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:16 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49 Jul 17 15:34:16 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:16 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49" returned: 0 in 0.401s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-894595993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452bcccd-6a7a-4c34-b354-d1b1eb3791c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af6120e0ef344c88868fa978598308a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:07Z,use_quota=True,user_id='4ffa4874efc44fa990abfcc553b5f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03e0a41e-51b5-4dad-b587-fea42d87345f),volume_type_id=03e0a41e-51b5-4dad-b587-fea42d87345f)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Creating volume 452bcccd-6a7a-4c34-b354-d1b1eb3791c9 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:16 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a0ccf3-bdb4-4e85-b3eb-87fa8cd98478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad386c3b-8af9-42d5-a883-11b47384ea49', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7239ba39-8415-42ae-9bcb-5f9715f038ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:16 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Volume volume-ad386c3b-8af9-42d5-a883-11b47384ea49 (ad386c3b-8af9-42d5-a883-11b47384ea49): created successfully Jul 17 15:34:16 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 1073741824 Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7239ba39-8415-42ae-9bcb-5f9715f038ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:16 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Flow 'volume_create_manager' (1aac645f-0511-4f3b-91ed-8aed47258bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-87cc6b0e-ed16-4f4d-8bfa-f6ba9c963d3d tempest-TestInstancesWithCinderVolumes-1768919279 None] Created volume successfully. Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-4788f52f-8cfd-4468-b8c7-9deb8308ebed-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-4788f52f-8cfd-4468-b8c7-9deb8308ebed-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Performing cascade delete. {{(pid=87769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-9dd2e64c-3774-4789-aac6-744b19d7616b-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-9dd2e64c-3774-4789-aac6-744b19d7616b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-4788f52f-8cfd-4468-b8c7-9deb8308ebed" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-4788f52f-8cfd-4468-b8c7-9deb8308ebed" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-9dd2e64c-3774-4789-aac6-744b19d7616b" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-9dd2e64c-3774-4789-aac6-744b19d7616b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Deleting offline snapshot 9dd2e64c-3774-4789-aac6-744b19d7616b of volume 4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] snapshot_file for this snap is: volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[39872611-ac8d-4ab7-b40e-024e5136ddf8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:17 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b Jul 17 15:34:17 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:18 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 1073741824" returned: 0 in 1.221s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:18 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 Jul 17 15:34:18 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:18 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b" returned: 0 in 0.793s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e00247e-c292-4445-8c26-0fcffeef7ff0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:18 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9" returned: 0 in 0.537s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:18 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed Jul 17 15:34:18 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Attempting download of 879429b6-c089-415c-b8c8-eba20819e6cf ((None, [{'url': 'file:///opt/stack/data/glance/images/879429b6-c089-415c-b8c8-eba20819e6cf', 'metadata': {}}])) to volume 452bcccd-6a7a-4c34-b354-d1b1eb3791c9. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Flow 'volume_create_manager' (38e3c026-4654-46f4-a4b4-8bc37a4136fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83418a4a-2ed3-48a0-a9bd-22157382df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b96437a-c7f0-48da-aef4-591fa48bd1af]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_879429b6-c089-415c-b8c8-eba20819e6cf_0a2f_usz {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83418a4a-2ed3-48a0-a9bd-22157382df17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1143781674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3aaf68-5d3a-4707-b844-2426652e4c1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01eb6bf9dae148dbbddd8232971ddae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:19Z,use_quota=True,user_id='93ae2d112bbe48c5a6d57bf6298c2644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f46f13-7bce-4028-85dc-8d7be19f9b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f46f13-7bce-4028-85dc-8d7be19f9b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5fc0d9-a13e-4ac2-b3c8-56294a5d0be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5fc0d9-a13e-4ac2-b3c8-56294a5d0be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3aaf68-5d3a-4707-b844-2426652e4c1f', 'volume_name': 'volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca04cce-1d46-4e9d-9dbe-302370ea8146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca04cce-1d46-4e9d-9dbe-302370ea8146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936108a9-fc5f-422d-a30c-23727bc26427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:18 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Volume fb3aaf68-5d3a-4707-b844-2426652e4c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f', 'volume_size': 1} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1143781674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3aaf68-5d3a-4707-b844-2426652e4c1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01eb6bf9dae148dbbddd8232971ddae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:19Z,use_quota=True,user_id='93ae2d112bbe48c5a6d57bf6298c2644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Creating volume fb3aaf68-5d3a-4707-b844-2426652e4c1f {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:18 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:34:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:19 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f 1073741824 Jul 17 15:34:19 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:19 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_879429b6-c089-415c-b8c8-eba20819e6cf_0a2f_usz Jul 17 15:34:19 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:19 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed" returned: 0 in 0.762s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:19 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b Jul 17 15:34:19 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:19 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_879429b6-c089-415c-b8c8-eba20819e6cf_0a2f_usz" returned: 0 in 0.752s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_879429b6-c089-415c-b8c8-eba20819e6cf_0a2f_usz {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:19 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_879429b6-c089-415c-b8c8-eba20819e6cf_0a2f_usz Jul 17 15:34:19 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:19 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f 1073741824" returned: 0 in 0.883s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:19 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b" returned: 0 in 0.553s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:19 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b Jul 17 15:34:19 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:19 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f Jul 17 15:34:19 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:20 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_879429b6-c089-415c-b8c8-eba20819e6cf_0a2f_usz" returned: 1 in 0.479s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_879429b6-c089-415c-b8c8-eba20819e6cf_0a2f_usz' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e748938-5b4a-422f-9d35-a12ed35e1ae4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:20 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed.9dd2e64c-3774-4789-aac6-744b19d7616b" returned: 0 in 0.332s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:20 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f" returned: 0 in 0.312s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-9dd2e64c-3774-4789-aac6-744b19d7616b" released by "_delete_snapshot" :: held 2.680s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936108a9-fc5f-422d-a30c-23727bc26427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:20 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD Jul 17 15:34:20 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5ce317-43eb-4e29-9c64-f5ac43cfdce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-4788f52f-8cfd-4468-b8c7-9deb8308ebed" released by "delete_snapshot" :: held 2.755s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Volume volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f (fb3aaf68-5d3a-4707-b844-2426652e4c1f): created successfully Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5ce317-43eb-4e29-9c64-f5ac43cfdce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Flow 'volume_create_manager' (38e3c026-4654-46f4-a4b4-8bc37a4136fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:20 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-9179b085-0ead-4c12-a540-ff2fd9506385 req-5f44939d-714a-482b-baaa-27823013b021 tempest-VolumesGetTestJSON-196754136 None] Created volume successfully. Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Created reservations ['0c4a982d-a4a5-4fcc-afb7-80fde7ad6bca', '939fff22-de30-4929-91b3-d0314b59d90f', 'e7ee2ce2-68f9-4a91-9645-a2cfebe63bc4', '16e516cf-3d4c-49ab-96b2-8ea4c19424a3'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:20 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Delete snapshot completed successfully. Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-9dd2e64c-3774-4789-aac6-744b19d7616b-delete_snapshot" released by "delete_snapshot" :: held 2.975s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Snapshots deleted, issuing volume delete {{(pid=87769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-4788f52f-8cfd-4468-b8c7-9deb8308ebed" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-4788f52f-8cfd-4468-b8c7-9deb8308ebed" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d9e79b-57b9-479a-948a-88867fe4664e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:20 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] 879429b6-c089-415c-b8c8-eba20819e6cf was qcow2, converting to qcow2 {{(pid=87769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 15:34:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:20 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 Jul 17 15:34:20 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:20 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed Jul 17 15:34:20 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:21 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed" returned: 0 in 0.596s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:21 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed Jul 17 15:34:21 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Acquiring lock "cinder-fb3aaf68-5d3a-4707-b844-2426652e4c1f-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Lock "cinder-fb3aaf68-5d3a-4707-b844-2426652e4c1f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Acquiring lock "cinder-quobyte-fb3aaf68-5d3a-4707-b844-2426652e4c1f" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Lock "cinder-quobyte-fb3aaf68-5d3a-4707-b844-2426652e4c1f" acquired by "delete_volume" :: waited 0.035s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:21 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4788f52f-8cfd-4468-b8c7-9deb8308ebed" returned: 0 in 0.526s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a484b1a-01a5-4ec1-a799-0ba34bb233ea]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-4788f52f-8cfd-4468-b8c7-9deb8308ebed" released by "delete_volume" :: held 1.232s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Created reservations ['4c78cea2-17b7-4a56-860a-e7eab5bc66f6', 'd62cb59b-f648-4a1d-8fff-5f49524c2194', '103a037c-8c64-432f-be42-4e9685a9e025', 'd5bdf62b-be05-4a54-887b-4c49b23a2afb'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:21 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f Jul 17 15:34:21 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:22 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:22 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:22 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f" returned: 0 in 0.822s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:22 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.502s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:22 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f Jul 17 15:34:22 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Deleted volume successfully. Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e320594e-db64-4bec-b5e6-8ce1d1497519 tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-4788f52f-8cfd-4468-b8c7-9deb8308ebed-delete_volume" released by "delete_volume" :: held 5.333s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:22 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:22 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:22 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-fb3aaf68-5d3a-4707-b844-2426652e4c1f" returned: 0 in 0.443s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Lock "cinder-quobyte-fb3aaf68-5d3a-4707-b844-2426652e4c1f" released by "delete_volume" :: held 1.373s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.quota [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Created reservations ['60cb08a2-766c-4844-af48-e7355bd1d99d', 'c1a0ace9-1692-40e8-8e5c-7075de79b63e', 'dc451168-214a-40fd-bfdc-465f792a2ab9', '28c70002-b8d8-41fd-9ad1-44431932bb98'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:23 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.465s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-942d242d-3003-4fb8-baea-14aaf2a8b100-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-942d242d-3003-4fb8-baea-14aaf2a8b100-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:23 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:23 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:23 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9" returned: 0 in 2.834s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_879429b6-c089-415c-b8c8-eba20819e6cf_rnsfpkl2devstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:34:23 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Converted 112.00 MB image at 39.51 MB/s Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "cinder-quobyte-942d242d-3003-4fb8-baea-14aaf2a8b100" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:23 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 1G Jul 17 15:34:23 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-942d242d-3003-4fb8-baea-14aaf2a8b100" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d111d6f6-89ef-4f08-b2a6-f870e2df0b1d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:23 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.manager [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Deleted volume successfully. Jul 17 15:34:23 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 Jul 17 15:34:23 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-0f2e2c58-1422-45bd-9a2e-777cf1f7e67e req-92e948c8-75f8-4ec7-b9fc-2f72c02bf8d4 tempest-VolumesGetTestJSON-196754136 None] Lock "cinder-fb3aaf68-5d3a-4707-b844-2426652e4c1f-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:23 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 1G" returned: 0 in 0.524s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Downloaded image 879429b6-c089-415c-b8c8-eba20819e6cf ((None, [{'url': 'file:///opt/stack/data/glance/images/879429b6-c089-415c-b8c8-eba20819e6cf', 'metadata': {}}])) to volume 452bcccd-6a7a-4c34-b354-d1b1eb3791c9 successfully. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Temporary image 879429b6-c089-415c-b8c8-eba20819e6cf for user 4ffa4874efc44fa990abfcc553b5f4a5 is deleted. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Marking volume 452bcccd-6a7a-4c34-b354-d1b1eb3791c9 as bootable. {{(pid=87769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Copying metadata from image 879429b6-c089-415c-b8c8-eba20819e6cf to 452bcccd-6a7a-4c34-b354-d1b1eb3791c9. {{(pid=87769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 15:34:23 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Creating volume glance metadata for volume 452bcccd-6a7a-4c34-b354-d1b1eb3791c9 backed by image 879429b6-c089-415c-b8c8-eba20819e6cf with: {'image_id': '879429b6-c089-415c-b8c8-eba20819e6cf', 'image_name': 'tempest-scenario-img--1692631523', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73c94e2-91bd-421c-8066-1541119fa172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9', 'volume_size': 1, 'image_id': '879429b6-c089-415c-b8c8-eba20819e6cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/879429b6-c089-415c-b8c8-eba20819e6cf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1692631523', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2af6120e0ef344c88868fa978598308a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '879429b6-c089-415c-b8c8-eba20819e6cf', 'created_at': datetime.datetime(2026, 7, 17, 13, 34, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 34, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/879429b6-c089-415c-b8c8-eba20819e6cf/file', 'properties': {}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6bdcdd-47f8-42b9-bb6b-449f7265412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:24 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Volume volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 (452bcccd-6a7a-4c34-b354-d1b1eb3791c9): created successfully Jul 17 15:34:24 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6bdcdd-47f8-42b9-bb6b-449f7265412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Flow 'volume_create_manager' (e54c7f05-6b41-4133-a763-4b44c04658dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100" returned: 0 in 0.590s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-564ab9a2-cfaa-4ea2-80af-39ccfa38669a tempest-TestInstancesWithCinderVolumes-1768919279 None] Created volume successfully. Jul 17 15:34:24 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100 Jul 17 15:34:24 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:24 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-942d242d-3003-4fb8-baea-14aaf2a8b100" returned: 0 in 0.296s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-quobyte-942d242d-3003-4fb8-baea-14aaf2a8b100" released by "delete_volume" :: held 0.953s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Created reservations ['51b86503-d54f-4c80-8d53-471c6d7cc2b6', 'f0a73abf-c731-42c3-9e49-03a7a8f41abc', 'ae9de76a-968e-4f6f-ae11-41f99241b76e', '9a6b6fde-f8be-4a87-bfc1-61465a56bb4c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:24 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:24 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:24 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.285s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Deleted volume successfully. Jul 17 15:34:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-987adcee-450b-43da-a923-14739918bdeb tempest-VolumesDeleteCascade-1139181936 None] Lock "cinder-942d242d-3003-4fb8-baea-14aaf2a8b100-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-19e689c1-1a20-4840-b848-0e7c6ab986fb req-3f6d2618-c40f-436d-8107-94ed536698ab tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-19e689c1-1a20-4840-b848-0e7c6ab986fb req-3f6d2618-c40f-436d-8107-94ed536698ab tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-19e689c1-1a20-4840-b848-0e7c6ab986fb req-3f6d2618-c40f-436d-8107-94ed536698ab tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-19e689c1-1a20-4840-b848-0e7c6ab986fb req-3f6d2618-c40f-436d-8107-94ed536698ab tempest-TestInstancesWithCinderVolumes-1768919279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15fd55b8-7878-42ab-890c-535c66c0f3db', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:34:29 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-19e689c1-1a20-4840-b848-0e7c6ab986fb req-3f6d2618-c40f-436d-8107-94ed536698ab tempest-TestInstancesWithCinderVolumes-1768919279 None] attachment_update completed successfully. Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Flow 'volume_create_manager' (5bb55537-1299-4f06-a7fe-12f31911c415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4680c308-b259-4952-aa77-2f8116d56c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4680c308-b259-4952-aa77-2f8116d56c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1315483600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9be843-488e-4ae6-87e2-d628611236af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20bfe83605db49a1a5c4e0effe324581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:31Z,use_quota=True,user_id='6d3208662a0b41428dcd06594b586bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cebd0d1-be5a-47ce-b307-ee13cea84ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cebd0d1-be5a-47ce-b307-ee13cea84ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786880c4-028d-4562-8991-60cfb8d703e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786880c4-028d-4562-8991-60cfb8d703e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a9be843-488e-4ae6-87e2-d628611236af', 'volume_name': 'volume-1a9be843-488e-4ae6-87e2-d628611236af', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4739050-c563-4fdb-a9b3-83a0dccf60b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4739050-c563-4fdb-a9b3-83a0dccf60b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f964691-6855-4d19-ac2f-383a4e8bc96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:30 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Volume 1a9be843-488e-4ae6-87e2-d628611236af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a9be843-488e-4ae6-87e2-d628611236af', 'volume_size': 1} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1315483600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9be843-488e-4ae6-87e2-d628611236af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20bfe83605db49a1a5c4e0effe324581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:31Z,use_quota=True,user_id='6d3208662a0b41428dcd06594b586bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Creating volume 1a9be843-488e-4ae6-87e2-d628611236af {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:30 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:34:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:31 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af 1073741824 Jul 17 15:34:31 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:31 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af 1073741824" returned: 0 in 0.744s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:31 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af Jul 17 15:34:31 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:32 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af" returned: 0 in 0.331s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f964691-6855-4d19-ac2f-383a4e8bc96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9be843-488e-4ae6-87e2-d628611236af', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3343b2ea-d626-43f9-b820-bbbabcbf703c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:32 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Volume volume-1a9be843-488e-4ae6-87e2-d628611236af (1a9be843-488e-4ae6-87e2-d628611236af): created successfully Jul 17 15:34:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3343b2ea-d626-43f9-b820-bbbabcbf703c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Flow 'volume_create_manager' (5bb55537-1299-4f06-a7fe-12f31911c415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-eee1a183-9656-4844-ad03-dd4fc1da68fa tempest-VolumesMetadataTest-1059488896 None] Created volume successfully. Jul 17 15:34:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Acquiring lock "cinder-1a9be843-488e-4ae6-87e2-d628611236af-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Lock "cinder-1a9be843-488e-4ae6-87e2-d628611236af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Acquiring lock "cinder-quobyte-1a9be843-488e-4ae6-87e2-d628611236af" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Lock "cinder-quobyte-1a9be843-488e-4ae6-87e2-d628611236af" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:34 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed624b0-003e-45c8-8abf-24c53a1523bb]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:34 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af Jul 17 15:34:34 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:34 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af" returned: 0 in 0.431s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:34 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af Jul 17 15:34:34 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:35 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1a9be843-488e-4ae6-87e2-d628611236af" returned: 0 in 0.399s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Lock "cinder-quobyte-1a9be843-488e-4ae6-87e2-d628611236af" released by "delete_volume" :: held 0.904s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e40bbbbf-9d0a-4a83-b16d-49103522ec70 tempest-BackendsCapabilitiesAdminTestsJSON-407575494 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7388076782227, 'free_capacity_gb': 1775.7388076782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87769) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97eb5987-3206-4e2d-998f-fdf959a64e01 tempest-BackendsCapabilitiesAdminTestsJSON-407575494 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7388076782227, 'free_capacity_gb': 1775.7388076782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87769) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Created reservations ['10d3863c-445f-4dd1-9969-871af39e5bac', 'b019f6f4-aaf8-423f-b99b-c2ae4f6816cb', 'eb05faa9-7952-46db-8909-28ffcdda700e', 'db547020-8d7c-43c3-becc-a9ff19345502'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:35 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:35 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:35 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.358s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:35 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Deleted volume successfully. Jul 17 15:34:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ccf795-8b49-4caf-8c85-3ffa39635c7c tempest-VolumesMetadataTest-1059488896 None] Lock "cinder-1a9be843-488e-4ae6-87e2-d628611236af-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=126,cinder:INSERT=30,cinder:UPDATE=126,cinder:DELETE=13 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=124,cinder:SELECT=121,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Flow 'volume_create_manager' (3276c67d-e422-459f-a73d-d6f9c8785e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8296e96f-2e8b-4f54-83a9-d4398e7ddda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8296e96f-2e8b-4f54-83a9-d4398e7ddda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1578471862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed66d97-a3ff-499b-9a89-44ebf473cf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7232972cc93d42b98b36b1973d76ef05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:43Z,use_quota=True,user_id='7b5db4a19610426fb43fd8b842675ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea821aa1-4de0-4c2e-a9c0-e49830baca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea821aa1-4de0-4c2e-a9c0-e49830baca3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab21eee-5992-458e-884b-79939563351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab21eee-5992-458e-884b-79939563351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed66d97-a3ff-499b-9a89-44ebf473cf1c', 'volume_name': 'volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896ed14b-811d-4fd7-82c3-dbdd2969e812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896ed14b-811d-4fd7-82c3-dbdd2969e812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005ea31c-0d4d-417d-b613-d966b3d3dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:43 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Volume 2ed66d97-a3ff-499b-9a89-44ebf473cf1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c', 'volume_size': 1} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1578471862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed66d97-a3ff-499b-9a89-44ebf473cf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7232972cc93d42b98b36b1973d76ef05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:43Z,use_quota=True,user_id='7b5db4a19610426fb43fd8b842675ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Creating volume 2ed66d97-a3ff-499b-9a89-44ebf473cf1c {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:43 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:34:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:43 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c 1073741824 Jul 17 15:34:43 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:44 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c 1073741824" returned: 0 in 0.659s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:44 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c Jul 17 15:34:44 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:44 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c" returned: 0 in 0.313s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005ea31c-0d4d-417d-b613-d966b3d3dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8690b0-41e8-4ba5-bedb-fd2dcbc02990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:44 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Volume volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c (2ed66d97-a3ff-499b-9a89-44ebf473cf1c): created successfully Jul 17 15:34:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8690b0-41e8-4ba5-bedb-fd2dcbc02990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Flow 'volume_create_manager' (3276c67d-e422-459f-a73d-d6f9c8785e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:44 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6d1a7440-ae6e-4088-9970-b98a904ed7f3 tempest-AttachVolumeNegativeTest-857928603 None] Created volume successfully. Jul 17 15:34:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f435cf93-29e2-4707-a7ba-d3ef58ab9a90 tempest-GroupSnapshotsTest-1487610488 None] Group tempest-GroupSnapshotsTest-Group-813444977: creating Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Flow 'volume_create_manager' (19fdf9e5-55b0-4ad5-97e8-8f71e4be0d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e17d38-ee2f-4f2a-b21f-adef5dde82dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e17d38-ee2f-4f2a-b21f-adef5dde82dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1234434325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3238a5-670c-4c8f-bad7-765458c04386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c944b909ff48fd91ea6cced440d3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:45Z,use_quota=True,user_id='e6495bbc5801468eb3a0a915928afc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61718be5-61a8-48bb-b592-47814eb1c1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61718be5-61a8-48bb-b592-47814eb1c1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1d3150-1cbd-426d-b21f-9a9ed2780230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1d3150-1cbd-426d-b21f-9a9ed2780230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3238a5-670c-4c8f-bad7-765458c04386', 'volume_name': 'volume-ad3238a5-670c-4c8f-bad7-765458c04386', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84528e70-d3e2-4499-88bb-500e1bf34c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84528e70-d3e2-4499-88bb-500e1bf34c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c6dee1-815b-4489-b9da-4f65c9a2d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Volume ad3238a5-670c-4c8f-bad7-765458c04386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3238a5-670c-4c8f-bad7-765458c04386', 'volume_size': 1} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1234434325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3238a5-670c-4c8f-bad7-765458c04386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c944b909ff48fd91ea6cced440d3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:45Z,use_quota=True,user_id='e6495bbc5801468eb3a0a915928afc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Creating volume ad3238a5-670c-4c8f-bad7-765458c04386 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:45 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:34:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f435cf93-29e2-4707-a7ba-d3ef58ab9a90 tempest-GroupSnapshotsTest-1487610488 None] Group tempest-GroupSnapshotsTest-Group-813444977: created successfully Jul 17 15:34:45 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386 1073741824 Jul 17 15:34:45 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f435cf93-29e2-4707-a7ba-d3ef58ab9a90 tempest-GroupSnapshotsTest-1487610488 None] Create group completed successfully. Jul 17 15:34:46 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386 1073741824" returned: 0 in 0.605s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:46 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386 Jul 17 15:34:46 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:46 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386" returned: 0 in 0.345s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c6dee1-815b-4489-b9da-4f65c9a2d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3238a5-670c-4c8f-bad7-765458c04386', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4770da-fcc2-4eb2-85c7-13b4f4f3a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-809a0b35-833b-4e87-90fc-c8147e67ef53 req-3e93d2f4-27c8-4f1f-ba5e-3c5fcb892166 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-809a0b35-833b-4e87-90fc-c8147e67ef53 req-3e93d2f4-27c8-4f1f-ba5e-3c5fcb892166 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:46 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Volume volume-ad3238a5-670c-4c8f-bad7-765458c04386 (ad3238a5-670c-4c8f-bad7-765458c04386): created successfully Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4770da-fcc2-4eb2-85c7-13b4f4f3a917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Flow 'volume_create_manager' (19fdf9e5-55b0-4ad5-97e8-8f71e4be0d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-809a0b35-833b-4e87-90fc-c8147e67ef53 req-3e93d2f4-27c8-4f1f-ba5e-3c5fcb892166 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:46 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-dd6e3194-9c43-4f50-bbef-a16fc7e804e0 tempest-VolumesTransfersTest-1145210811 None] Created volume successfully. Jul 17 15:34:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-809a0b35-833b-4e87-90fc-c8147e67ef53 req-3e93d2f4-27c8-4f1f-ba5e-3c5fcb892166 tempest-AttachVolumeNegativeTest-857928603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1f9fe18-697c-4445-a758-24c9c677c370', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:34:46 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-809a0b35-833b-4e87-90fc-c8147e67ef53 req-3e93d2f4-27c8-4f1f-ba5e-3c5fcb892166 tempest-AttachVolumeNegativeTest-857928603 None] attachment_update completed successfully. Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Flow 'volume_create_manager' (9ba362c0-d1cc-4712-afba-5a493e00d548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8fc19d-317d-42ef-a4ec-9ed4075ceac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8fc19d-317d-42ef-a4ec-9ed4075ceac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-168118743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91d37901-c03b-49d5-995f-2975a4c466b0,host='devstack@QuobyteHD#QuobyteHD',id=42cabecc-5bb8-445d-82a0-fe82f6f2a22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8f89d8d2e48d8a0c6d1d84e051595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:47Z,use_quota=True,user_id='025178bf5071477ba8ab865c943170be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a14f21a8-b387-4fd2-b88b-ea915fd69126),volume_type_id=a14f21a8-b387-4fd2-b88b-ea915fd69126)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db16ce3a-8a74-449c-b7b9-7d4bff917ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db16ce3a-8a74-449c-b7b9-7d4bff917ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c322d0-4482-445b-8809-7d7064fe1812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c322d0-4482-445b-8809-7d7064fe1812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cabecc-5bb8-445d-82a0-fe82f6f2a22c', 'volume_name': 'volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1632db19-cea8-4ac8-aadd-ae8eeb5b97a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1632db19-cea8-4ac8-aadd-ae8eeb5b97a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3166a3-5697-494d-8341-1e045ffba460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:47 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Volume 42cabecc-5bb8-445d-82a0-fe82f6f2a22c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c', 'volume_size': 1} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91d37901-c03b-49d5-995f-2975a4c466b0,created_at=2026-07-17T13:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-168118743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91d37901-c03b-49d5-995f-2975a4c466b0,host='devstack@QuobyteHD#QuobyteHD',id=42cabecc-5bb8-445d-82a0-fe82f6f2a22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8f89d8d2e48d8a0c6d1d84e051595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:47Z,use_quota=True,user_id='025178bf5071477ba8ab865c943170be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a14f21a8-b387-4fd2-b88b-ea915fd69126),volume_type_id=a14f21a8-b387-4fd2-b88b-ea915fd69126)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Creating volume 42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:47 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:47 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c 1073741824 Jul 17 15:34:47 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:47 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c 1073741824" returned: 0 in 0.546s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:47 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c Jul 17 15:34:47 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-34548c4e-2aea-4a99-8057-863a4ab2fd0f tempest-VolumesTransfersTest-656500761 None] Transfer volume completed successfully. Jul 17 15:34:48 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3166a3-5697-494d-8341-1e045ffba460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1d3091-13af-4325-bb82-57df5382360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:48 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Volume volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c (42cabecc-5bb8-445d-82a0-fe82f6f2a22c): created successfully Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1d3091-13af-4325-bb82-57df5382360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Flow 'volume_create_manager' (9ba362c0-d1cc-4712-afba-5a493e00d548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c0ae4ef6-c8be-4df9-9b67-be3d6d509775 tempest-GroupSnapshotsTest-1487610488 None] Created volume successfully. Jul 17 15:34:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] GroupSnapshot 7dea4812-0826-424c-9197-c889084e61bb: creating. Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Group snapshot 7dea4812-0826-424c-9197-c889084e61bb: creating. {{(pid=87769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Creating offline snapshot 8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 of volume 42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ac18a1-0818-4fde-82f6-7cf6a898d86d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:48 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c Jul 17 15:34:48 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Acquiring lock "cinder-ad3238a5-670c-4c8f-bad7-765458c04386-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Lock "cinder-ad3238a5-670c-4c8f-bad7-765458c04386-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Acquiring lock "cinder-quobyte-ad3238a5-670c-4c8f-bad7-765458c04386" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Lock "cinder-quobyte-ad3238a5-670c-4c8f-bad7-765458c04386" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a4232a-9611-405e-a95e-f0433c730fe0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:49 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386 Jul 17 15:34:49 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:49 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" returned: 0 in 0.565s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:49 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 1G Jul 17 15:34:49 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:49 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-e9fbeca9-0b3e-40f8-8e0d-bea1f15655b3 req-94be802d-bbc0-47c1-847d-f0ab781a7a4c tempest-AttachVolumeNegativeTest-857928603 None] Terminate volume connection completed successfully. Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e9fbeca9-0b3e-40f8-8e0d-bea1f15655b3 req-94be802d-bbc0-47c1-847d-f0ab781a7a4c tempest-AttachVolumeNegativeTest-857928603 None] Deleting attachment a1f9fe18-697c-4445-a758-24c9c677c370. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:34:49 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386" returned: 0 in 0.480s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:49 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386 Jul 17 15:34:49 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:49 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 1G" returned: 0 in 0.509s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:49 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 Jul 17 15:34:49 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:49 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad3238a5-670c-4c8f-bad7-765458c04386" returned: 0 in 0.298s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Lock "cinder-quobyte-ad3238a5-670c-4c8f-bad7-765458c04386" released by "delete_volume" :: held 0.837s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Created reservations ['7b17fb44-9845-4459-8ed3-47cb439ef0a0', '32d677a7-9a0f-4bed-961d-038b89f8220f', '6ae422e7-2cc2-4a8b-894e-a921833a2425', 'efca9a63-1a2f-45e6-986d-d8920527d87f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:50 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:50 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:50 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8" returned: 0 in 0.444s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:50 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:50 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 Jul 17 15:34:50 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:50 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.328s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:50 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Deleted volume successfully. Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab3a17a1-4f5c-48d6-aaa8-cabb42005b8f tempest-VolumesTransfersTest-1421908898 None] Lock "cinder-ad3238a5-670c-4c8f-bad7-765458c04386-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:50 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8" returned: 0 in 0.433s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:50 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.info Jul 17 15:34:50 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Flow 'volume_create_manager' (f518f9ff-8433-45ea-b445-709afc3f9057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:51 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1061825-0ef6-4e78-a931-c67dd476f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.info" returned: 0 in 0.541s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:51 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1061825-0ef6-4e78-a931-c67dd476f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1680966408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6846fe58-1505-4b34-999b-e6d272dc905e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c944b909ff48fd91ea6cced440d3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:51Z,use_quota=True,user_id='e6495bbc5801468eb3a0a915928afc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:51 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.info Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4218a678-e7b2-4f79-af87-ea27a7d7ffa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:51 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4218a678-e7b2-4f79-af87-ea27a7d7ffa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8143ae-0d78-41d2-a900-eb633e97583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8143ae-0d78-41d2-a900-eb633e97583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6846fe58-1505-4b34-999b-e6d272dc905e', 'volume_name': 'volume-6846fe58-1505-4b34-999b-e6d272dc905e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097d8b70-4c34-4bf5-95bc-34333b15ea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097d8b70-4c34-4bf5-95bc-34333b15ea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce13200-d83d-49ae-a9cc-5de96a0f3437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Volume 6846fe58-1505-4b34-999b-e6d272dc905e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6846fe58-1505-4b34-999b-e6d272dc905e', 'volume_size': 1} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:51 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.info" returned: 0 in 0.480s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.124s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1680966408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6846fe58-1505-4b34-999b-e6d272dc905e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c944b909ff48fd91ea6cced440d3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:34:51Z,use_quota=True,user_id='e6495bbc5801468eb3a0a915928afc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Creating volume 6846fe58-1505-4b34-999b-e6d272dc905e {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:51 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:34:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:51 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e 1073741824 Jul 17 15:34:51 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-73f1ade1-e7eb-41c5-a9aa-e4f4bd856ecd tempest-GroupSnapshotsTest-1487610488 None] group_snapshot 7dea4812-0826-424c-9197-c889084e61bb: created successfully Jul 17 15:34:52 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e 1073741824" returned: 0 in 0.759s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:52 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e Jul 17 15:34:52 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:53 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce13200-d83d-49ae-a9cc-5de96a0f3437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6846fe58-1505-4b34-999b-e6d272dc905e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc261a-c6f9-4868-a288-1a236ce2a10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:34:53 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Volume volume-6846fe58-1505-4b34-999b-e6d272dc905e (6846fe58-1505-4b34-999b-e6d272dc905e): created successfully Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc261a-c6f9-4868-a288-1a236ce2a10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Flow 'volume_create_manager' (f518f9ff-8433-45ea-b445-709afc3f9057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:34:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a7d8c914-1ada-4fd9-b5a6-2adcabff9f14 tempest-VolumesTransfersTest-1145210811 None] Created volume successfully. Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Acquiring lock "cinder-6846fe58-1505-4b34-999b-e6d272dc905e-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Lock "cinder-6846fe58-1505-4b34-999b-e6d272dc905e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Acquiring lock "cinder-quobyte-6846fe58-1505-4b34-999b-e6d272dc905e" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Lock "cinder-quobyte-6846fe58-1505-4b34-999b-e6d272dc905e" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd20e868-679c-4bce-82bc-3feeac49f708]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8-f921aa79-bd9d-43b0-9615-402c159c20b1" by "_create_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8-f921aa79-bd9d-43b0-9615-402c159c20b1" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Creating volume f921aa79-bd9d-43b0-9615-402c159c20b1 from snapshot 8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 {{(pid=87769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-f921aa79-bd9d-43b0-9615-402c159c20b1" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:54 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e Jul 17 15:34:54 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-f921aa79-bd9d-43b0-9615-402c159c20b1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] snapshot: 8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8, volume: f921aa79-bd9d-43b0-9615-402c159c20b1, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80912eb-23eb-4df2-a369-79e9a7c82fd0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:54 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 Jul 17 15:34:54 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:54 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e" returned: 0 in 0.529s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:54 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e Jul 17 15:34:54 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:54 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8" returned: 0 in 0.408s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a238317d-66e3-40b2-9983-a0b7e630465a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:54 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6846fe58-1505-4b34-999b-e6d272dc905e" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:54 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c Jul 17 15:34:54 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Lock "cinder-quobyte-6846fe58-1505-4b34-999b-e6d272dc905e" released by "delete_volume" :: held 0.868s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "cinder-2ed66d97-a3ff-499b-9a89-44ebf473cf1c-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-2ed66d97-a3ff-499b-9a89-44ebf473cf1c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Created reservations ['ea08768c-4610-42ed-96f4-76ce30317b9f', '5682499c-9ef9-4150-87b1-0ec16dfc3c16', '1a6901e3-86e5-4a40-8ab6-418ba3b07dce', 'fa196c80-c419-435d-be90-c1bd507010e3'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "cinder-quobyte-2ed66d97-a3ff-499b-9a89-44ebf473cf1c" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-quobyte-2ed66d97-a3ff-499b-9a89-44ebf473cf1c" acquired by "delete_volume" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c36a0d-b661-45b0-bc97-b376668e4356]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:54 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:54 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:54 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c Jul 17 15:34:54 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:55 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" returned: 0 in 0.480s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:55 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 Jul 17 15:34:55 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:55 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.292s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Deleted volume successfully. Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-53053c2e-4915-4553-bfaf-04f53636ae69 tempest-VolumesTransfersTest-1421908898 None] Lock "cinder-6846fe58-1505-4b34-999b-e6d272dc905e-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:55 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c" returned: 0 in 0.439s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:55 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c Jul 17 15:34:55 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:55 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2ed66d97-a3ff-499b-9a89-44ebf473cf1c" returned: 0 in 0.278s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-quobyte-2ed66d97-a3ff-499b-9a89-44ebf473cf1c" released by "delete_volume" :: held 0.786s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Created reservations ['62f0f6e5-ede7-43c5-92b9-669e302a23b5', 'dfcd0b02-2407-4db0-b61f-5d9515eb9662', '889afd73-e99d-46a2-8228-4b6e79da7594', '2a6cebd7-20eb-4f62-b3b7-f58e34aefe6b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:55 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:55 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "cinder-aa481beb-6f40-427d-9cbd-8e103421188a-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:56 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.617s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:56 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-aa481beb-6f40-427d-9cbd-8e103421188a-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Deleted volume successfully. Jul 17 15:34:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9dc8021e-8d8a-4b21-9860-bfb7a53785d8 tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-2ed66d97-a3ff-499b-9a89-44ebf473cf1c-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "cinder-quobyte-aa481beb-6f40-427d-9cbd-8e103421188a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-quobyte-aa481beb-6f40-427d-9cbd-8e103421188a" acquired by "delete_volume" :: waited 0.043s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:34:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a65b6c6-d08d-43e6-b890-15ba8c1b9540]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:34:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:57 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a Jul 17 15:34:57 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:57 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a" returned: 0 in 0.968s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:57 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a Jul 17 15:34:57 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:58 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-aa481beb-6f40-427d-9cbd-8e103421188a" returned: 0 in 0.433s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-quobyte-aa481beb-6f40-427d-9cbd-8e103421188a" released by "delete_volume" :: held 1.519s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:58 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Created reservations ['f7478215-e3af-4d04-ad97-5d77e74a8acd', 'ddf8b4bc-95f9-4ee6-91ec-59a90fb400bb', 'c898577a-2033-427b-b3f4-491dee825985', '1f2f4220-c605-41b1-8bd2-a53afcb164e4'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:34:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:34:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:34:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:34:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:34:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:34:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:34:58 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:34:58 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:34:59 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jul 17 15:34:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.662s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:34:59 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:34:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Deleted volume successfully. Jul 17 15:34:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a4cd5fce-1823-441b-b624-6ef9f394539e tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-aa481beb-6f40-427d-9cbd-8e103421188a-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:34:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "cinder-46b2f35f-690f-4b2d-81e0-61d7168804b9-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:34:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-46b2f35f-690f-4b2d-81e0-61d7168804b9-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "cinder-quobyte-46b2f35f-690f-4b2d-81e0-61d7168804b9" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-quobyte-46b2f35f-690f-4b2d-81e0-61d7168804b9" acquired by "delete_volume" :: waited 0.044s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[608636ba-e088-49f3-9327-7ae2c7752ef3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:00 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 Jul 17 15:35:00 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:00 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9" returned: 0 in 0.749s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:01 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9 Jul 17 15:35:01 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1" returned: 0 in 6.642s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca220f58-de8f-48a1-b327-68953a0dcd05]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:01 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-46b2f35f-690f-4b2d-81e0-61d7168804b9" returned: 0 in 0.791s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-quobyte-46b2f35f-690f-4b2d-81e0-61d7168804b9" released by "delete_volume" :: held 1.661s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Created reservations ['87730b1c-582e-4842-90b8-ceab10651ad2', '2c3d770a-f3f6-42df-9884-e9a69ba30cd6', '0a88a52c-f289-405d-8853-b4e3fad8d33d', '65f41893-78fc-4b0f-a0c6-233c683f4bbf'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:01 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c Jul 17 15:35:01 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:01 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:01 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:02 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.293s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Deleted volume successfully. Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-eeaf2fe0-5836-48a3-ab15-e875523bacf3 tempest-AttachVolumeNegativeTest-857928603 None] Lock "cinder-46b2f35f-690f-4b2d-81e0-61d7168804b9-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:02 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" returned: 0 in 0.710s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:35:02 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Converted 1024.00 MB image at 154.15 MB/s Jul 17 15:35:02 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:02 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 Jul 17 15:35:02 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:02 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1" returned: 0 in 0.323s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-f921aa79-bd9d-43b0-9615-402c159c20b1" released by "_copy_volume_from_snapshot" :: held 8.706s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8-f921aa79-bd9d-43b0-9615-402c159c20b1" released by "_create_volume_from_snapshot" :: held 8.754s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.780s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-97e9a992-3cf3-4a69-bd9a-8facf669de61 tempest-GroupSnapshotsTest-1487610488 None] Create group from source-snapshot-7dea4812-0826-424c-9197-c889084e61bb completed successfully. Jul 17 15:35:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-f921aa79-bd9d-43b0-9615-402c159c20b1" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-f921aa79-bd9d-43b0-9615-402c159c20b1" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:04 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[120f97e4-61c9-4c94-bb35-1c731188697c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:04 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 Jul 17 15:35:04 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:05 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1" returned: 0 in 0.462s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:05 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1 Jul 17 15:35:05 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:05 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f921aa79-bd9d-43b0-9615-402c159c20b1" returned: 0 in 0.360s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-f921aa79-bd9d-43b0-9615-402c159c20b1" released by "delete_volume" :: held 0.886s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['e3964f8a-b4d8-4107-ace9-15b1154ecc46'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:05 devstack cinder-volume[87769]: WARNING cinder.quota [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-198101812 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-198101812, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:05 devstack cinder-volume[87769]: WARNING cinder.quota [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-198101812 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-198101812, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['04abaefe-e1ac-4b62-bbbf-0bd419eac5f3', 'bb503103-0637-4b40-82c2-26527686778f', '1503de81-d94a-4825-8c61-4d19a425d3a9', '2f6f09ee-c1cb-4c7e-b39d-5c00d6d61c16'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:05 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:05 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-0fb6bcf4-6c19-489a-abbb-004a64c65591 req-0dc093ee-ca6f-4fd4-8018-55a72b99a106 tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-0fb6bcf4-6c19-489a-abbb-004a64c65591 req-0dc093ee-ca6f-4fd4-8018-55a72b99a106 tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-0fb6bcf4-6c19-489a-abbb-004a64c65591 req-0dc093ee-ca6f-4fd4-8018-55a72b99a106 tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-0fb6bcf4-6c19-489a-abbb-004a64c65591 req-0dc093ee-ca6f-4fd4-8018-55a72b99a106 tempest-TestInstancesWithCinderVolumes-1768919279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-3d809a62-63a8-4d78-b657-09e6ba85f1db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c305ff2-0cc1-4c31-bfc3-9ed381d1729d', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:35:06 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.323s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:06 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c0f637bb-9421-4efd-bffc-7696c126be27 tempest-GroupSnapshotsTest-1487610488 None] Delete group completed successfully. Jul 17 15:35:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-0fb6bcf4-6c19-489a-abbb-004a64c65591 req-0dc093ee-ca6f-4fd4-8018-55a72b99a106 tempest-TestInstancesWithCinderVolumes-1768919279 None] attachment_update completed successfully. Jul 17 15:35:06 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Flow 'volume_create_manager' (79749d6e-0a25-4cf3-bfa1-548b9ab15908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9636b9f-009f-4f70-9589-925e1fe76666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9636b9f-009f-4f70-9589-925e1fe76666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-612131578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e927c4-f8d8-4e9a-9eb0-d954e87f9a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dd7a6f6593452c9f7d0b2ed633a060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:07Z,use_quota=True,user_id='c69bb86f9e314c5494ace2f79d1f8a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a7f982-ee63-4ddc-9579-1c2c9d5b18b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a7f982-ee63-4ddc-9579-1c2c9d5b18b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2deba2d-c7cb-433f-80ee-704ca1a79835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2deba2d-c7cb-433f-80ee-704ca1a79835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07e927c4-f8d8-4e9a-9eb0-d954e87f9a44', 'volume_name': 'volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f75b868-3b21-401f-a2a2-eb7cf2045f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f75b868-3b21-401f-a2a2-eb7cf2045f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d409378-c8e6-4f4f-b1fb-3587062a598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:07 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Volume 07e927c4-f8d8-4e9a-9eb0-d954e87f9a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44', 'volume_size': 1} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-612131578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e927c4-f8d8-4e9a-9eb0-d954e87f9a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dd7a6f6593452c9f7d0b2ed633a060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:07Z,use_quota=True,user_id='c69bb86f9e314c5494ace2f79d1f8a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Creating volume 07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:07 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:07 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] group_snapshot 7dea4812-0826-424c-9197-c889084e61bb: deleting Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] group_snapshot 7dea4812-0826-424c-9197-c889084e61bb: deleting {{(pid=87769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 15:35:07 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 1073741824 Jul 17 15:35:07 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Deleting offline snapshot 8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 of volume 42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] snapshot_file for this snap is: volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[580c0988-d0a6-439e-b2a0-67cc70dc3d94]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:07 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 Jul 17 15:35:07 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:07 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 1073741824" returned: 0 in 0.574s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:07 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8" returned: 0 in 0.490s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:35:07 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 Jul 17 15:35:07 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3277a99-d826-45c5-891d-712cd7bab9a9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:07 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c Jul 17 15:35:07 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:08 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44" returned: 0 in 0.301s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d409378-c8e6-4f4f-b1fb-3587062a598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12456cc4-c909-455e-87e8-ecc7f3d9c9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:08 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Volume volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 (07e927c4-f8d8-4e9a-9eb0-d954e87f9a44): created successfully Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12456cc4-c909-455e-87e8-ecc7f3d9c9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Flow 'volume_create_manager' (79749d6e-0a25-4cf3-bfa1-548b9ab15908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:08 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8e6bb5dc-a05b-4d75-9784-2b579ed31ebc tempest-VolumesTransfersV355Test-2058832768 None] Created volume successfully. Jul 17 15:35:08 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" returned: 0 in 0.500s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:08 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 Jul 17 15:35:08 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:08 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8" returned: 0 in 0.432s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:08 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8 Jul 17 15:35:08 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:09 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c.8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8" returned: 0 in 0.360s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8ef83cf5-f639-40d1-9a2f-f7578a1ca0f8" released by "_delete_snapshot" :: held 1.931s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" released by "delete_snapshot" :: held 1.959s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:09 devstack cinder-volume[87769]: WARNING cinder.quota [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-198101812 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-198101812, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:09 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['6c69c10c-1b2a-4dc0-abcf-496ea198460c', '8303382c-1c39-4397-bd89-496e9e591687', '987c2b40-2688-4d70-af2e-4c4f3db5f912', '417143b9-3470-4708-b2e0-62eb6f302485'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-9638879c-7b7c-4db0-9084-744e092f27ba req-66f85451-01a3-48ff-8c28-18a0772169a2 tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-9638879c-7b7c-4db0-9084-744e092f27ba req-66f85451-01a3-48ff-8c28-18a0772169a2 tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-9638879c-7b7c-4db0-9084-744e092f27ba req-66f85451-01a3-48ff-8c28-18a0772169a2 tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-94f21f64-85cd-4612-898a-d631d33d8119 tempest-GroupSnapshotsTest-1487610488 None] group_snapshot 7dea4812-0826-424c-9197-c889084e61bb: deleted successfully Jul 17 15:35:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9638879c-7b7c-4db0-9084-744e092f27ba req-66f85451-01a3-48ff-8c28-18a0772169a2 tempest-TestInstancesWithCinderVolumes-1768919279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-ad386c3b-8af9-42d5-a883-11b47384ea49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eab8bfb1-4a4e-49d1-ad33-261456176f72', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:35:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-9638879c-7b7c-4db0-9084-744e092f27ba req-66f85451-01a3-48ff-8c28-18a0772169a2 tempest-TestInstancesWithCinderVolumes-1768919279 None] attachment_update completed successfully. Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:10 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8b6c9989-0e2b-466e-8679-31873479ca38 tempest-VolumesTransfersV355Test-1289710216 None] Transfer volume completed successfully. Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" acquired by "delete_volume" :: waited 0.039s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade61780-1a5a-42bd-8691-b24557ce4445]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:10 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c Jul 17 15:35:10 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:10 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" returned: 0 in 0.467s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:10 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c Jul 17 15:35:10 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Acquiring lock "cinder-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Lock "cinder-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Acquiring lock "cinder-quobyte-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Lock "cinder-quobyte-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc5ac6a-4a81-4f4d-995d-adb094fcb576]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:10 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" returned: 0 in 0.321s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-42cabecc-5bb8-445d-82a0-fe82f6f2a22c" released by "delete_volume" :: held 0.876s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:10 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 Jul 17 15:35:10 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:10 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['b3bee574-eb6b-408f-88a7-e3c1421ad31d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:11 devstack cinder-volume[87769]: WARNING cinder.db.api [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-198101812'] Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['c404b354-c080-459e-8517-ea764496c670', '0bdd3fe2-34e8-4631-aae8-565df920254b', '0218f261-3271-46f9-9d52-dc1fb4d4e9c3', '103b36c2-f30f-492b-b999-954cc7e48d85'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:11 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:11 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Flow 'volume_create_manager' (c6f694d1-a4a4-44af-8987-4a06b300220c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2a8c30-dea6-4d61-ac61-accaf2003f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2a8c30-dea6-4d61-ac61-accaf2003f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1225588739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa01745-7d01-4273-bbc9-3d47491d8cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ec67226d7a4970ac6574a3747b9fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:11Z,use_quota=True,user_id='e0f2f677a3f44d2ab62e3d1a3b976c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1bf924-620c-4b6c-8559-d1b77dee5ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1bf924-620c-4b6c-8559-d1b77dee5ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1adf21e7-03e5-40fd-bdf2-1ce9d396444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1adf21e7-03e5-40fd-bdf2-1ce9d396444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa01745-7d01-4273-bbc9-3d47491d8cfb', 'volume_name': 'volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fc4d4d-7924-4518-b3b8-144bba64f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fc4d4d-7924-4518-b3b8-144bba64f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a906325-2096-4195-9395-82b984ec85e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:11 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Volume 7aa01745-7d01-4273-bbc9-3d47491d8cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb', 'volume_size': 1} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:11 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1225588739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa01745-7d01-4273-bbc9-3d47491d8cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ec67226d7a4970ac6574a3747b9fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:11Z,use_quota=True,user_id='e0f2f677a3f44d2ab62e3d1a3b976c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Creating volume 7aa01745-7d01-4273-bbc9-3d47491d8cfb {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:11 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44" returned: 0 in 0.466s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:11 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb 1073741824 Jul 17 15:35:11 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:11 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44 Jul 17 15:35:11 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:11 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.366s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9e816184-3857-400a-8a7b-882b7b4a202d tempest-GroupSnapshotsTest-1487610488 None] Delete group completed successfully. Jul 17 15:35:11 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44" returned: 0 in 0.343s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Lock "cinder-quobyte-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44" released by "delete_volume" :: held 0.856s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Created reservations ['c47c6d34-f0f9-4134-9b30-98b50033a6e4', '68221e84-44e5-46fe-be00-efe2f1ee5fc8', 'b67e93a0-9c23-42bd-bcf8-3db231a978e5', '5db7df20-1d19-4c9f-948e-53237c3448d2'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a7ac9921-9425-4944-8ae7-aef5f78f102c tempest-GroupSnapshotsTest-1487610488 None] Group tempest-GroupSnapshotsTest-Group-1713314138: creating Jul 17 15:35:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a7ac9921-9425-4944-8ae7-aef5f78f102c tempest-GroupSnapshotsTest-1487610488 None] Group tempest-GroupSnapshotsTest-Group-1713314138: created successfully Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a7ac9921-9425-4944-8ae7-aef5f78f102c tempest-GroupSnapshotsTest-1487610488 None] Create group completed successfully. Jul 17 15:35:11 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:11 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:12 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb 1073741824" returned: 0 in 0.694s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:12 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb Jul 17 15:35:12 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:12 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.339s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:12 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Deleted volume successfully. Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6b24e592-f45a-4d29-86b8-88d8e5720aa9 tempest-VolumesTransfersV355Test-1055805867 None] Lock "cinder-07e927c4-f8d8-4e9a-9eb0-d954e87f9a44-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:12 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a906325-2096-4195-9395-82b984ec85e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fbb935-4b0e-4297-90c4-505a59060915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:12 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Volume volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb (7aa01745-7d01-4273-bbc9-3d47491d8cfb): created successfully Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fbb935-4b0e-4297-90c4-505a59060915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Flow 'volume_create_manager' (c6f694d1-a4a4-44af-8987-4a06b300220c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:12 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-e297dc69-6572-45bb-a871-58ca3ccf11a2 req-6520107b-8fba-4efa-81c1-7f1328265678 tempest-VolumesSnapshotsTestJSON-243348919 None] Created volume successfully. Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Flow 'volume_create_manager' (f159d05b-a4da-4471-a5cd-bba1909e3837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef26a87-8bf4-428a-ac61-fe4e7d9423c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef26a87-8bf4-428a-ac61-fe4e7d9423c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2100616052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8146888f-4ef1-4246-80dc-e2423a214e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dd7a6f6593452c9f7d0b2ed633a060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:13Z,use_quota=True,user_id='c69bb86f9e314c5494ace2f79d1f8a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1fb6f6-2314-4f55-bf81-9a1738da2ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1fb6f6-2314-4f55-bf81-9a1738da2ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca9fb21-c6a9-4b5f-b799-7735a77a38b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca9fb21-c6a9-4b5f-b799-7735a77a38b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8146888f-4ef1-4246-80dc-e2423a214e9d', 'volume_name': 'volume-8146888f-4ef1-4246-80dc-e2423a214e9d', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe0bd19-e8cc-40bd-b0d0-5e64d4dd6fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe0bd19-e8cc-40bd-b0d0-5e64d4dd6fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e57aee2-5e3c-49ba-832a-d70a5714fa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:12 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Volume 8146888f-4ef1-4246-80dc-e2423a214e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8146888f-4ef1-4246-80dc-e2423a214e9d', 'volume_size': 1} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2100616052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8146888f-4ef1-4246-80dc-e2423a214e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dd7a6f6593452c9f7d0b2ed633a060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:13Z,use_quota=True,user_id='c69bb86f9e314c5494ace2f79d1f8a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Creating volume 8146888f-4ef1-4246-80dc-e2423a214e9d {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:12 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:12 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d 1073741824 Jul 17 15:35:12 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:13 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d 1073741824" returned: 0 in 0.478s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:13 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d Jul 17 15:35:13 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Flow 'volume_create_manager' (5b41c9a3-f9b4-467d-afdd-5abd2d83019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864236c8-0d8a-44b1-9c04-1a51d2a926c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864236c8-0d8a-44b1-9c04-1a51d2a926c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-940458209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72e7a7b6-ef09-4d35-8c32-34272abcd2f9,host='devstack@QuobyteHD#QuobyteHD',id=9e318199-4144-4661-8a89-17b622f8dc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8f89d8d2e48d8a0c6d1d84e051595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:14Z,use_quota=True,user_id='025178bf5071477ba8ab865c943170be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dd45c59-6525-4ef0-9baa-9fe069f53222),volume_type_id=0dd45c59-6525-4ef0-9baa-9fe069f53222)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c238e5-3c7a-4f31-9684-b5ffe3787b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c238e5-3c7a-4f31-9684-b5ffe3787b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2347efd0-6138-42c0-a066-f0b10b7b68c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2347efd0-6138-42c0-a066-f0b10b7b68c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e318199-4144-4661-8a89-17b622f8dc28', 'volume_name': 'volume-9e318199-4144-4661-8a89-17b622f8dc28', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:13 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d218b15-e297-4f22-9f42-42c8d18dd79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d218b15-e297-4f22-9f42-42c8d18dd79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd944fa9-5fc1-440b-97ac-11d40c0c3aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:13 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Volume 9e318199-4144-4661-8a89-17b622f8dc28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e318199-4144-4661-8a89-17b622f8dc28', 'volume_size': 1} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d" returned: 0 in 0.514s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72e7a7b6-ef09-4d35-8c32-34272abcd2f9,created_at=2026-07-17T13:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-940458209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72e7a7b6-ef09-4d35-8c32-34272abcd2f9,host='devstack@QuobyteHD#QuobyteHD',id=9e318199-4144-4661-8a89-17b622f8dc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8f89d8d2e48d8a0c6d1d84e051595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:14Z,use_quota=True,user_id='025178bf5071477ba8ab865c943170be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dd45c59-6525-4ef0-9baa-9fe069f53222),volume_type_id=0dd45c59-6525-4ef0-9baa-9fe069f53222)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Creating volume 9e318199-4144-4661-8a89-17b622f8dc28 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:13 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:13 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 1073741824 Jul 17 15:35:13 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e57aee2-5e3c-49ba-832a-d70a5714fa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8146888f-4ef1-4246-80dc-e2423a214e9d', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85d3643-e295-4f2d-b25e-a6a4adf316dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:13 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Volume volume-8146888f-4ef1-4246-80dc-e2423a214e9d (8146888f-4ef1-4246-80dc-e2423a214e9d): created successfully Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85d3643-e295-4f2d-b25e-a6a4adf316dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Flow 'volume_create_manager' (f159d05b-a4da-4471-a5cd-bba1909e3837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:13 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7c9944c9-f7b3-490e-bd57-47c49dd40179 tempest-VolumesTransfersV355Test-2058832768 None] Created volume successfully. Jul 17 15:35:14 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 1073741824" returned: 0 in 0.476s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:14 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 Jul 17 15:35:14 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:14 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28" returned: 0 in 0.263s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.690s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Creating offline snapshot 39e600d2-c658-4627-ba27-8b10778a8e56 of volume 7aa01745-7d01-4273-bbc9-3d47491d8cfb {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd944fa9-5fc1-440b-97ac-11d40c0c3aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e318199-4144-4661-8a89-17b622f8dc28', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5392effa-5fdf-455d-87ed-0d465e46f996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2751a6-6968-4e31-8e59-07f443eddb8b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:14 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Volume volume-9e318199-4144-4661-8a89-17b622f8dc28 (9e318199-4144-4661-8a89-17b622f8dc28): created successfully Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5392effa-5fdf-455d-87ed-0d465e46f996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:14 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Flow 'volume_create_manager' (5b41c9a3-f9b4-467d-afdd-5abd2d83019d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8ab5e766-f9b5-476b-88a5-bcfe9893e174 tempest-GroupSnapshotsTest-1487610488 None] Created volume successfully. Jul 17 15:35:14 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb Jul 17 15:35:14 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:15 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb" returned: 0 in 0.423s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:15 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 1G Jul 17 15:35:15 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Acquiring lock "cinder-8146888f-4ef1-4246-80dc-e2423a214e9d-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Lock "cinder-8146888f-4ef1-4246-80dc-e2423a214e9d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Acquiring lock "cinder-quobyte-8146888f-4ef1-4246-80dc-e2423a214e9d" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Lock "cinder-quobyte-8146888f-4ef1-4246-80dc-e2423a214e9d" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae65b60-fb07-4ff2-8318-a428a1d4bc06]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Flow 'volume_create_manager' (045a8822-4157-409c-a8f6-31ccbe56a06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc81f27-ced4-41ab-8dce-a6d261d23a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc81f27-ced4-41ab-8dce-a6d261d23a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2109663660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72e7a7b6-ef09-4d35-8c32-34272abcd2f9,host='devstack@QuobyteHD#QuobyteHD',id=8ff6f489-f58c-462b-a640-5357f4aafa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8f89d8d2e48d8a0c6d1d84e051595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:16Z,use_quota=True,user_id='025178bf5071477ba8ab865c943170be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dd45c59-6525-4ef0-9baa-9fe069f53222),volume_type_id=0dd45c59-6525-4ef0-9baa-9fe069f53222)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0ca66e-9b1c-4829-b116-73b041fd59f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:15 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0ca66e-9b1c-4829-b116-73b041fd59f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e89efa6-8c7f-4d31-82d9-b2d02c9b6421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e89efa6-8c7f-4d31-82d9-b2d02c9b6421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff6f489-f58c-462b-a640-5357f4aafa52', 'volume_name': 'volume-8ff6f489-f58c-462b-a640-5357f4aafa52', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:15 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f00afc-5f04-455b-90c7-028d6525c38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:15 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f00afc-5f04-455b-90c7-028d6525c38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee99a614-1572-4b15-bd5d-7b4fbfb0824a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:15 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Volume 8ff6f489-f58c-462b-a640-5357f4aafa52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff6f489-f58c-462b-a640-5357f4aafa52', 'volume_size': 1} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 1G" returned: 0 in 0.700s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:15 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 Jul 17 15:35:15 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-c4be211b-b2ee-45e8-9bc0-97c37efa2e64 req-5e6e2825-43fe-43e3-a1c7-e856bf9afcee tempest-TestInstancesWithCinderVolumes-1768919279 None] Terminate volume connection completed successfully. Jul 17 15:35:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-c4be211b-b2ee-45e8-9bc0-97c37efa2e64 req-5e6e2825-43fe-43e3-a1c7-e856bf9afcee tempest-TestInstancesWithCinderVolumes-1768919279 None] Deleting attachment 6c305ff2-0cc1-4c31-bfc3-9ed381d1729d. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:35:16 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d" returned: 0 in 0.435s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:16 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d Jul 17 15:35:16 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:16 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56" returned: 0 in 0.330s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:16 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 is being set with open permissions: ugo+rw Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:16 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 Jul 17 15:35:16 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:16 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8146888f-4ef1-4246-80dc-e2423a214e9d" returned: 0 in 0.286s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Lock "cinder-quobyte-8146888f-4ef1-4246-80dc-e2423a214e9d" released by "delete_volume" :: held 0.796s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:16 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56" returned: 0 in 0.269s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Created reservations ['fe8f6d60-ad05-48a7-bcda-3b41b590770d', '99b6b035-5f42-4c0f-bfb8-b53c499ce005', 'cbb07b74-84db-4276-a631-38a071287eaa', 'fee5a368-ddc8-4b6e-870c-3083199f9fb8'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:16 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.info Jul 17 15:35:16 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:16 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:16 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "cinder-3d809a62-63a8-4d78-b657-09e6ba85f1db-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-3d809a62-63a8-4d78-b657-09e6ba85f1db-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "cinder-quobyte-3d809a62-63a8-4d78-b657-09e6ba85f1db" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-quobyte-3d809a62-63a8-4d78-b657-09e6ba85f1db" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95edc7b-339e-4514-b291-f10cefdf1019]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:16 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.info" returned: 0 in 0.395s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:16 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.info is being set with open permissions: ugo+rw Jul 17 15:35:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:16 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.info Jul 17 15:35:16 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:16 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db Jul 17 15:35:16 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:17 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.505s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:17 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Deleted volume successfully. Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-371ce6db-d7bc-4cb4-902b-2a2c2270b3e4 tempest-VolumesTransfersV355Test-1055805867 None] Lock "cinder-8146888f-4ef1-4246-80dc-e2423a214e9d-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:17 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.info" returned: 0 in 0.342s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.583s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72e7a7b6-ef09-4d35-8c32-34272abcd2f9,created_at=2026-07-17T13:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2109663660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72e7a7b6-ef09-4d35-8c32-34272abcd2f9,host='devstack@QuobyteHD#QuobyteHD',id=8ff6f489-f58c-462b-a640-5357f4aafa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8f89d8d2e48d8a0c6d1d84e051595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:16Z,use_quota=True,user_id='025178bf5071477ba8ab865c943170be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dd45c59-6525-4ef0-9baa-9fe069f53222),volume_type_id=0dd45c59-6525-4ef0-9baa-9fe069f53222)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Creating volume 8ff6f489-f58c-462b-a640-5357f4aafa52 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:17 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:17 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 1073741824 Jul 17 15:35:17 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:17 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-40600f8a-e1cb-46f5-952c-ffc3dd968b52 req-5bf75172-4ac1-44c1-ab8e-9aea6806e66d tempest-VolumesSnapshotsTestJSON-243348919 None] Create snapshot completed successfully Jul 17 15:35:17 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db" returned: 0 in 0.517s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:17 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db Jul 17 15:35:17 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Acquiring lock "cinder-39e600d2-c658-4627-ba27-8b10778a8e56-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-39e600d2-c658-4627-ba27-8b10778a8e56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Acquiring lock "cinder-quobyte-7aa01745-7d01-4273-bbc9-3d47491d8cfb" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-quobyte-7aa01745-7d01-4273-bbc9-3d47491d8cfb" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Acquiring lock "cinder-quobyte-39e600d2-c658-4627-ba27-8b10778a8e56" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-quobyte-39e600d2-c658-4627-ba27-8b10778a8e56" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Deleting offline snapshot 39e600d2-c658-4627-ba27-8b10778a8e56 of volume 7aa01745-7d01-4273-bbc9-3d47491d8cfb {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] snapshot_file for this snap is: volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[009201b6-8276-49e6-a5c6-9281e017b4ef]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:17 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:17 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3d809a62-63a8-4d78-b657-09e6ba85f1db" returned: 0 in 0.581s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 1073741824" returned: 0 in 0.683s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:17 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 Jul 17 15:35:17 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-quobyte-3d809a62-63a8-4d78-b657-09e6ba85f1db" released by "delete_volume" :: held 1.187s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:17 devstack cinder-volume[87769]: WARNING cinder.quota [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-485638126-1337904645 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-485638126-1337904645, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:17 devstack cinder-volume[87769]: WARNING cinder.quota [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-485638126-1337904645 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-485638126-1337904645, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Created reservations ['004cb050-ad08-4ec3-ba8f-521a50af5427', 'b46e6418-2928-49dc-91ad-3dbd8f90223d', '19ea33d9-117a-465d-aece-405c01c6611e', '201fa778-899f-4fc7-b04f-b5faddc6e0f7'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:18 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 Jul 17 15:35:18 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:18 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:18 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:18 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56" returned: 0 in 0.635s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2962da8-1d6b-41f5-9c92-148956c7de99]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:18 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52" returned: 0 in 0.536s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee99a614-1572-4b15-bd5d-7b4fbfb0824a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff6f489-f58c-462b-a640-5357f4aafa52', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f874639b-f5c5-437a-bb42-b8cb9167a775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:18 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.414s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:18 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb Jul 17 15:35:18 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:18 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Deleted volume successfully. Jul 17 15:35:18 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Volume volume-8ff6f489-f58c-462b-a640-5357f4aafa52 (8ff6f489-f58c-462b-a640-5357f4aafa52): created successfully Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f874639b-f5c5-437a-bb42-b8cb9167a775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Flow 'volume_create_manager' (045a8822-4157-409c-a8f6-31ccbe56a06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:18 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6278b991-de88-4878-b625-7d9b213e34a7 tempest-GroupSnapshotsTest-1487610488 None] Created volume successfully. Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-68f8bb43-632e-4c17-b0a1-d1bfdb303d6d tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-3d809a62-63a8-4d78-b657-09e6ba85f1db-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:18 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb" returned: 0 in 0.486s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:18 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 Jul 17 15:35:18 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:19 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56" returned: 0 in 0.406s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:19 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56 Jul 17 15:35:19 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:19 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb.39e600d2-c658-4627-ba27-8b10778a8e56" returned: 0 in 0.344s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-quobyte-39e600d2-c658-4627-ba27-8b10778a8e56" released by "_delete_snapshot" :: held 2.074s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-quobyte-7aa01745-7d01-4273-bbc9-3d47491d8cfb" released by "delete_snapshot" :: held 2.128s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:19 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b87dac57-064f-4bfd-b7bd-835e600a7ad5 tempest-GroupSnapshotsTest-1487610488 None] Update group completed successfully. Jul 17 15:35:19 devstack cinder-volume[87769]: DEBUG cinder.quota [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Created reservations ['4dbe82e5-912e-4cdb-880a-f208e97992cc', 'ba069ebe-7cae-4447-ace8-f42136ce5f3a', '99258ed8-37a6-4c4e-916d-e60ab0cb373f', '05457282-f79f-42d1-96d0-60b70b61e584'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:19 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Delete snapshot completed successfully. Jul 17 15:35:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-64fbbf1c-8121-4a22-9f3a-40e18d8a3222 req-25902aa4-bca8-4a54-887e-7623aa3d7583 tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-39e600d2-c658-4627-ba27-8b10778a8e56-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2e8ec078-6267-4451-905e-6a275afda537 tempest-GroupSnapshotsTest-1487610488 None] Update group completed successfully. Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Acquiring lock "cinder-7aa01745-7d01-4273-bbc9-3d47491d8cfb-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-7aa01745-7d01-4273-bbc9-3d47491d8cfb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-1f6a3f31-daa0-4744-ad0c-2667db5768e4 req-25553c94-8ae1-4d23-99f6-3fc9ede463da tempest-TestInstancesWithCinderVolumes-1768919279 None] Terminate volume connection completed successfully. Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-1f6a3f31-daa0-4744-ad0c-2667db5768e4 req-25553c94-8ae1-4d23-99f6-3fc9ede463da tempest-TestInstancesWithCinderVolumes-1768919279 None] Deleting attachment eab8bfb1-4a4e-49d1-ad33-261456176f72. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Acquiring lock "cinder-quobyte-7aa01745-7d01-4273-bbc9-3d47491d8cfb" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-quobyte-7aa01745-7d01-4273-bbc9-3d47491d8cfb" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa61df8-408a-4369-a27c-4a9f4e69c3a2]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:21 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb Jul 17 15:35:21 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:21 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb" returned: 0 in 0.416s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:21 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb Jul 17 15:35:21 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "cinder-ad386c3b-8af9-42d5-a883-11b47384ea49-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-ad386c3b-8af9-42d5-a883-11b47384ea49-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "cinder-quobyte-ad386c3b-8af9-42d5-a883-11b47384ea49" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-quobyte-ad386c3b-8af9-42d5-a883-11b47384ea49" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:21 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7aa01745-7d01-4273-bbc9-3d47491d8cfb" returned: 0 in 0.312s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be32042-0c49-4699-be1d-565daa3b985b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-quobyte-7aa01745-7d01-4273-bbc9-3d47491d8cfb" released by "delete_volume" :: held 0.835s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG cinder.quota [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Created reservations ['3825fb90-976c-4ffb-b511-9396cb15d18c', '9b77d89f-66e6-43ea-90a0-7f44d9ece5c9', 'fce577fe-e304-491b-9bda-398ba1cbd6fd', '38343923-9b78-46b1-9db1-4010d1d2d4e2'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:22 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49 Jul 17 15:35:22 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:22 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:22 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f946ed0e-cba7-43a8-a9e4-e909037449b8 tempest-GroupSnapshotsTest-1487610488 None] Update group completed successfully. Jul 17 15:35:22 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49" returned: 0 in 0.609s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:22 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49 Jul 17 15:35:22 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:22 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.483s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG cinder.manager [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Deleted volume successfully. Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-3c6ae53f-5717-4b2c-83c3-68492a8d78f9 req-03a2f02f-a309-435c-8873-df1d0517320b tempest-VolumesSnapshotsTestJSON-243348919 None] Lock "cinder-7aa01745-7d01-4273-bbc9-3d47491d8cfb-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:35:22 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad386c3b-8af9-42d5-a883-11b47384ea49" returned: 0 in 0.349s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-quobyte-ad386c3b-8af9-42d5-a883-11b47384ea49" released by "delete_volume" :: held 1.029s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:22 devstack cinder-volume[87769]: WARNING cinder.quota [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1987513534-1639550760 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1987513534-1639550760, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:22 devstack cinder-volume[87769]: WARNING cinder.quota [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1987513534-1639550760 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1987513534-1639550760, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Created reservations ['67dae8cf-0e46-4eb3-8142-c3eecaeeb935', '06882ef8-b7ba-42d2-a2a3-fd12e711c9fb', 'ad6fc028-021a-495c-a0be-5e846581cab4', '4b019c27-120f-4300-a2ad-49547c4b96aa'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:23 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:23 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:23 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.452s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Deleted volume successfully. Jul 17 15:35:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2f1fa918-227c-44a4-8e15-45987b20421f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-ad386c3b-8af9-42d5-a883-11b47384ea49-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-16c97507-dd23-4dc2-9abd-305230881b5f tempest-GroupSnapshotsTest-1487610488 None] Update group completed successfully. Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Flow 'volume_create_manager' (50acb296-472f-4df5-8db2-4e9a56b8f348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d92ba0-08a3-48e5-9381-c36e61091512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d92ba0-08a3-48e5-9381-c36e61091512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1916914375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2759511f-16ad-4967-80bb-29b8941733e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72b1c182d534ac39ec37011a87b2e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:24Z,use_quota=True,user_id='38142ba5b94645f0adb34adbc6e8047d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc01c7a1-d49b-47a2-8247-32bf13b7396c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc01c7a1-d49b-47a2-8247-32bf13b7396c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b52eb4-4606-4be0-948a-9336b984c5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b52eb4-4606-4be0-948a-9336b984c5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2759511f-16ad-4967-80bb-29b8941733e4', 'volume_name': 'volume-2759511f-16ad-4967-80bb-29b8941733e4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9872ca1c-997a-4a26-8255-d9003d28d468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9872ca1c-997a-4a26-8255-d9003d28d468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9ff021-f695-46be-9d15-71ececa9a362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:24 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Volume 2759511f-16ad-4967-80bb-29b8941733e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2759511f-16ad-4967-80bb-29b8941733e4', 'volume_size': 1} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1916914375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2759511f-16ad-4967-80bb-29b8941733e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72b1c182d534ac39ec37011a87b2e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:24Z,use_quota=True,user_id='38142ba5b94645f0adb34adbc6e8047d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Creating volume 2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:24 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:24 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 1073741824 Jul 17 15:35:24 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:24 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 1073741824" returned: 0 in 0.621s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:25 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 Jul 17 15:35:25 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:25 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4" returned: 0 in 0.386s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9ff021-f695-46be-9d15-71ececa9a362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2759511f-16ad-4967-80bb-29b8941733e4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7f25ba-9fa3-4d7e-b220-2d8ff4f838ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:25 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Volume volume-2759511f-16ad-4967-80bb-29b8941733e4 (2759511f-16ad-4967-80bb-29b8941733e4): created successfully Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7f25ba-9fa3-4d7e-b220-2d8ff4f838ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Flow 'volume_create_manager' (50acb296-472f-4df5-8db2-4e9a56b8f348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] GroupSnapshot a44ceda8-9578-414f-b862-cc529e743e63: creating. Jul 17 15:35:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-304e37a8-e13b-412c-9e91-3670c04e0718 tempest-VolumesCloneTest-838544983 None] Created volume successfully. Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Group snapshot a44ceda8-9578-414f-b862-cc529e743e63: creating. {{(pid=87769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Creating offline snapshot 11f960e3-a92a-4b05-8eb0-4d76de132612 of volume 8ff6f489-f58c-462b-a640-5357f4aafa52 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed7a91-3546-43d5-94cb-c41f1c80c1c8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:25 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 Jul 17 15:35:25 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:26 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52" returned: 0 in 0.722s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:26 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 1G Jul 17 15:35:26 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:27 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-1c5cb1aa-243b-4c2f-8b05-92aa8e103aa4 req-66d9d797-8ac1-414c-bbc5-b70b0ae08161 tempest-TestInstancesWithCinderVolumes-1768919279 None] Terminate volume connection completed successfully. Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-1c5cb1aa-243b-4c2f-8b05-92aa8e103aa4 req-66d9d797-8ac1-414c-bbc5-b70b0ae08161 tempest-TestInstancesWithCinderVolumes-1768919279 None] Deleting attachment 15fd55b8-7878-42ab-890c-535c66c0f3db. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:27 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Flow 'volume_create_manager' (553cd1b9-7c90-4b02-9d2f-039134629d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fdcac7-aa83-409e-936c-f2cecac4bc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 1G" returned: 0 in 0.909s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff6f489-f58c-462b-a640-5357f4aafa52 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fdcac7-aa83-409e-936c-f2cecac4bc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1922318864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d11e69-bd27-4173-ac1c-b943e08be5cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72b1c182d534ac39ec37011a87b2e53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2759511f-16ad-4967-80bb-29b8941733e4,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:27Z,use_quota=True,user_id='38142ba5b94645f0adb34adbc6e8047d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d98b87-c4d2-4746-8c36-aca4784ac1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d98b87-c4d2-4746-8c36-aca4784ac1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:27 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff6f489-f58c-462b-a640-5357f4aafa52 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 Jul 17 15:35:27 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1945535-b7f6-420a-b1b7-4aac554ff146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1945535-b7f6-420a-b1b7-4aac554ff146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c8d11e69-bd27-4173-ac1c-b943e08be5cf', 'volume_name': 'volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf', 'volume_size': 2, 'source_volid': '2759511f-16ad-4967-80bb-29b8941733e4', 'source_volstatus': 'available'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc96dea-5733-4a55-a030-29c4193e01d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc96dea-5733-4a55-a030-29c4193e01d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cef6d5-568c-4b58-82e1-589ee2bdaec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:27 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Volume c8d11e69-bd27-4173-ac1c-b943e08be5cf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf', 'volume_size': 2, 'source_volid': '2759511f-16ad-4967-80bb-29b8941733e4', 'source_volstatus': 'available'} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:27 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff6f489-f58c-462b-a640-5357f4aafa52 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612" returned: 0 in 0.386s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:27 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:27 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 Jul 17 15:35:27 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:27 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:27 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.info Jul 17 15:35:27 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "cinder-452bcccd-6a7a-4c34-b354-d1b1eb3791c9-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-452bcccd-6a7a-4c34-b354-d1b1eb3791c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "cinder-quobyte-452bcccd-6a7a-4c34-b354-d1b1eb3791c9" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-quobyte-452bcccd-6a7a-4c34-b354-d1b1eb3791c9" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:28 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.info" returned: 0 in 0.320s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:28 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac11ba-283f-4b50-ae68-89fe5e723f1d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:28 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.info Jul 17 15:35:28 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:28 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 Jul 17 15:35:28 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:28 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.info" returned: 0 in 0.285s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Creating offline snapshot 6c59d181-0a40-45e7-b1ca-dc0e53b6494f of volume 9e318199-4144-4661-8a89-17b622f8dc28 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7c392-3dac-4f92-8675-9f88994418b0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:28 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9" returned: 0 in 0.413s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:28 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9 Jul 17 15:35:28 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:28 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 Jul 17 15:35:28 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:28 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-452bcccd-6a7a-4c34-b354-d1b1eb3791c9" returned: 0 in 0.283s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-quobyte-452bcccd-6a7a-4c34-b354-d1b1eb3791c9" released by "delete_volume" :: held 0.745s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:28 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28" returned: 0 in 0.391s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:29 devstack cinder-volume[87769]: WARNING cinder.quota [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1846632596-1410477067 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1846632596-1410477067, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:29 devstack cinder-volume[87769]: WARNING cinder.quota [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1846632596-1410477067 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1846632596-1410477067, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:29 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f 1G Jul 17 15:35:29 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Created reservations ['581ab02e-7862-4fb6-b6a4-e4f852526dc3', '3b093ff1-fb51-44f4-b65c-02264ef816e1', 'c589e035-15e3-4249-a944-f00f8c870ad0', '57de4ece-3931-4674-9f6f-7ba7ae54b162'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:29 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:29 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:29 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.325s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:29 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Deleted volume successfully. Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b9bae25f-60cd-47ec-b09e-143ff19a0d6f tempest-TestInstancesWithCinderVolumes-1768919279 None] Lock "cinder-452bcccd-6a7a-4c34-b354-d1b1eb3791c9-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:29 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f 1G" returned: 0 in 0.546s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e318199-4144-4661-8a89-17b622f8dc28 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:29 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e318199-4144-4661-8a89-17b622f8dc28 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f Jul 17 15:35:29 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:29 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e318199-4144-4661-8a89-17b622f8dc28 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f" returned: 0 in 0.368s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:29 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:29 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f Jul 17 15:35:29 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:30 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f" returned: 0 in 0.285s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:30 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.info Jul 17 15:35:30 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:30 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.info" returned: 0 in 0.308s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:30 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:30 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.info Jul 17 15:35:30 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:30 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.info" returned: 0 in 0.294s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.530s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:30 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Cloning volume 2759511f-16ad-4967-80bb-29b8941733e4 to volume c8d11e69-bd27-4173-ac1c-b943e08be5cf Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Creating offline snapshot 4bbcfbb7-fa40-481c-980a-fbded9a33e90 of volume 2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[65095eb5-385e-44aa-92ff-1624c0b37d37]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:31 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c1079d83-005d-4626-a6b2-484f800f37aa tempest-GroupSnapshotsTest-1487610488 None] group_snapshot a44ceda8-9578-414f-b862-cc529e743e63: created successfully Jul 17 15:35:31 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 Jul 17 15:35:31 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:31 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4" returned: 0 in 0.425s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:31 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 1G Jul 17 15:35:31 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:31 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 1G" returned: 0 in 0.509s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2759511f-16ad-4967-80bb-29b8941733e4 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:31 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2759511f-16ad-4967-80bb-29b8941733e4 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 Jul 17 15:35:31 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] group_snapshot a44ceda8-9578-414f-b862-cc529e743e63: deleting Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] group_snapshot a44ceda8-9578-414f-b862-cc529e743e63: deleting {{(pid=87769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-8ff6f489-f58c-462b-a640-5357f4aafa52" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8ff6f489-f58c-462b-a640-5357f4aafa52" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-11f960e3-a92a-4b05-8eb0-4d76de132612" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-11f960e3-a92a-4b05-8eb0-4d76de132612" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Deleting offline snapshot 11f960e3-a92a-4b05-8eb0-4d76de132612 of volume 8ff6f489-f58c-462b-a640-5357f4aafa52 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] snapshot_file for this snap is: volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3670a468-ad50-495b-971e-e46d817e026f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:32 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2759511f-16ad-4967-80bb-29b8941733e4 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90" returned: 0 in 0.465s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:32 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 is being set with open permissions: ugo+rw Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:32 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 Jul 17 15:35:32 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:32 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 Jul 17 15:35:32 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:32 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90" returned: 0 in 0.347s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:32 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.info Jul 17 15:35:32 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:32 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612" returned: 0 in 0.565s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ff6f489-f58c-462b-a640-5357f4aafa52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dbf9fc-af8c-4eac-94dd-5419604c3878]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:33 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 Jul 17 15:35:33 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:33 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.info" returned: 0 in 0.293s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:33 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.info is being set with open permissions: ugo+rw Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:33 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.info Jul 17 15:35:33 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:33 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52" returned: 0 in 0.441s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:33 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.info" returned: 0 in 0.300s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:33 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 Jul 17 15:35:33 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Acquiring lock "cinder-quobyte-c8d11e69-bd27-4173-ac1c-b943e08be5cf" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Lock "cinder-quobyte-c8d11e69-bd27-4173-ac1c-b943e08be5cf" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] snapshot: 4bbcfbb7-fa40-481c-980a-fbded9a33e90, volume: c8d11e69-bd27-4173-ac1c-b943e08be5cf, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58c72f1-e093-4efe-bdc9-d3316c058f48]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:33 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 Jul 17 15:35:33 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:33 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612" returned: 0 in 0.458s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:33 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612 Jul 17 15:35:33 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:33 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90" returned: 0 in 0.454s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2759511f-16ad-4967-80bb-29b8941733e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9930be9-de04-48a5-b598-6fe27fa787b4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:34 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52.11f960e3-a92a-4b05-8eb0-4d76de132612" returned: 0 in 0.297s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:34 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 Jul 17 15:35:34 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-11f960e3-a92a-4b05-8eb0-4d76de132612" released by "_delete_snapshot" :: held 1.905s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8ff6f489-f58c-462b-a640-5357f4aafa52" released by "delete_snapshot" :: held 1.955s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-9e318199-4144-4661-8a89-17b622f8dc28" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-9e318199-4144-4661-8a89-17b622f8dc28" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-6c59d181-0a40-45e7-b1ca-dc0e53b6494f" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-6c59d181-0a40-45e7-b1ca-dc0e53b6494f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Deleting offline snapshot 6c59d181-0a40-45e7-b1ca-dc0e53b6494f of volume 9e318199-4144-4661-8a89-17b622f8dc28 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] snapshot_file for this snap is: volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a1ffe6-efee-408e-b289-1cb47a8a7a75]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:34 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:34 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f Jul 17 15:35:34 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4" returned: 0 in 0.540s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:34 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2eef9a39-7ab3-47ec-b7aa-f48e9d7d7c3d tempest-GroupsV314Test-72423976 None] Group tempest-GroupsV314Test-Group-817826703: creating Jul 17 15:35:34 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf Jul 17 15:35:34 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:34 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2eef9a39-7ab3-47ec-b7aa-f48e9d7d7c3d tempest-GroupsV314Test-72423976 None] Group tempest-GroupsV314Test-Group-817826703: created successfully Jul 17 15:35:34 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2eef9a39-7ab3-47ec-b7aa-f48e9d7d7c3d tempest-GroupsV314Test-72423976 None] Create group completed successfully. Jul 17 15:35:34 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f" returned: 0 in 0.517s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e318199-4144-4661-8a89-17b622f8dc28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88a8899-88e3-4b3d-a8e6-86bbf530d1ea]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:34 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 Jul 17 15:35:34 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:35 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28" returned: 0 in 0.604s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:35 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f Jul 17 15:35:35 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:36 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f" returned: 0 in 1.120s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:36 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f Jul 17 15:35:36 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Flow 'volume_create_manager' (3e166886-3268-4cc8-a1b1-b2e11f9251eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed9dd25-f108-4d47-9b38-83ef8ee051d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed9dd25-f108-4d47-9b38-83ef8ee051d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960790921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=610e5760-e9c0-4f7d-99bb-86fd7ea3d571,host='devstack@QuobyteHD#QuobyteHD',id=0e723fba-d486-486a-ba7a-9274167eadbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958ceff8c27d47e4b39e3e382c45724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:37Z,use_quota=True,user_id='7ca166bb030b4e94b202df263b0997c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27f35b36-6ccb-4686-928d-52ca47ec1d80),volume_type_id=27f35b36-6ccb-4686-928d-52ca47ec1d80)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d0f0bb-2a6f-4347-b829-6154352f14c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d0f0bb-2a6f-4347-b829-6154352f14c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:37 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d325080-00d5-4254-9649-b5f9ea563648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d325080-00d5-4254-9649-b5f9ea563648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e723fba-d486-486a-ba7a-9274167eadbf', 'volume_name': 'volume-0e723fba-d486-486a-ba7a-9274167eadbf', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df6aeea-febd-433f-90d4-743c9f0d8b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df6aeea-febd-433f-90d4-743c9f0d8b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f5321a-e2d3-478c-a6c4-a2589ae580b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:37 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Volume 0e723fba-d486-486a-ba7a-9274167eadbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e723fba-d486-486a-ba7a-9274167eadbf', 'volume_size': 1} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28.6c59d181-0a40-45e7-b1ca-dc0e53b6494f" returned: 0 in 0.833s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-6c59d181-0a40-45e7-b1ca-dc0e53b6494f" released by "_delete_snapshot" :: held 3.250s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-9e318199-4144-4661-8a89-17b622f8dc28" released by "delete_snapshot" :: held 3.297s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:37 devstack cinder-volume[87769]: WARNING cinder.quota [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-676169471 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-676169471, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:37 devstack cinder-volume[87769]: WARNING cinder.quota [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-676169471 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-676169471, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:37 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['cf3cb002-1c02-4409-a96c-fb5775c2efaa', 'f9ba2c62-3530-4e3d-8e7c-37ca5c6ab0e7', '2cf17b07-feb5-4377-abde-549e15d24092', 'd90a7629-2148-420b-98a3-0d303b62c873'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:38 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['02876ad1-1b81-4a2f-a8ef-359b5adc8b0c', '94e0fdd2-a36b-4c39-9f32-82b1bc9228b1', 'd8741357-9e14-4452-9a18-9aebc5c6982b', '29936530-8639-458c-9e86-d4fa452e41b1'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:38 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0429c6c5-592a-413d-ba38-03cd342ee99b tempest-GroupSnapshotsTest-1487610488 None] group_snapshot a44ceda8-9578-414f-b862-cc529e743e63: deleted successfully Jul 17 15:35:40 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf" returned: 0 in 5.767s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d88bbc0-86ee-41a3-99cd-3b7b8b68f637]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-8ff6f489-f58c-462b-a640-5357f4aafa52" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8ff6f489-f58c-462b-a640-5357f4aafa52" acquired by "delete_volume" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02b8921-fc27-449f-99f3-f14598596f4e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:40 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 Jul 17 15:35:40 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:40 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 Jul 17 15:35:40 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:40 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52" returned: 0 in 0.374s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:40 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52 Jul 17 15:35:40 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:40 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4" returned: 0 in 0.665s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:35:40 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Converted 1024.00 MB image at 177.50 MB/s Jul 17 15:35:40 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf is being set with open permissions: ugo+rw Jul 17 15:35:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:40 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf Jul 17 15:35:40 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:41 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ff6f489-f58c-462b-a640-5357f4aafa52" returned: 0 in 0.250s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8ff6f489-f58c-462b-a640-5357f4aafa52" released by "delete_volume" :: held 0.707s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-9e318199-4144-4661-8a89-17b622f8dc28" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-9e318199-4144-4661-8a89-17b622f8dc28" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1fe9ad-822f-466d-a5a9-f1b9c67bd165]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:41 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf" returned: 0 in 0.286s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Lock "cinder-quobyte-c8d11e69-bd27-4173-ac1c-b943e08be5cf" released by "_copy_volume_from_snapshot" :: held 7.843s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Acquiring lock "cinder-quobyte-4bbcfbb7-fa40-481c-980a-fbded9a33e90" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Lock "cinder-quobyte-4bbcfbb7-fa40-481c-980a-fbded9a33e90" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Deleting offline snapshot 4bbcfbb7-fa40-481c-980a-fbded9a33e90 of volume 2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] snapshot_file for this snap is: volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:35:41 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 Jul 17 15:35:41 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9743369-cabc-441b-9170-6c63e5c4d173]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:41 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 Jul 17 15:35:41 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:41 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28" returned: 0 in 0.452s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:41 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28 Jul 17 15:35:41 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:41 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90" returned: 0 in 0.549s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2759511f-16ad-4967-80bb-29b8941733e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0389900e-6183-4afa-a783-f9bef6e79709]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:42 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9e318199-4144-4661-8a89-17b622f8dc28" returned: 0 in 0.407s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:42 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 Jul 17 15:35:42 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-9e318199-4144-4661-8a89-17b622f8dc28" released by "delete_volume" :: held 0.926s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['65334737-991d-4e4b-929a-e906ca4d3be5'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:42 devstack cinder-volume[87769]: WARNING cinder.quota [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-676169471 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-676169471, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['4251fcaa-1b9d-4839-88fd-b02aade1061f', '119253ab-e9b3-44a8-b23c-96f7eed8add1', 'ff742eb3-3e6a-4d15-a27e-a64e2119d1fc', '6db037ef-8eb7-4766-955d-1623f7673018'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:42 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4" returned: 0 in 0.460s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['78b16988-3a9e-460b-a3fa-34ce0c2d2ba8', '4c1d8db9-e0b9-4fc4-ab5e-1cd3d834ef0a', '3cf8855b-bb0f-48f9-98cc-d0c9b27055ab', '810c539b-8dc8-47c5-aefa-11c014b8c3f2'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:42 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 Jul 17 15:35:42 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:42 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:42 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:42 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.295s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-72082225-cf7f-489a-ba2d-e27a9add8b8b tempest-GroupSnapshotsTest-1487610488 None] Delete group completed successfully. Jul 17 15:35:42 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90" returned: 0 in 0.544s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:42 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90 Jul 17 15:35:42 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:43 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4.4bbcfbb7-fa40-481c-980a-fbded9a33e90" returned: 0 in 0.286s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Lock "cinder-quobyte-4bbcfbb7-fa40-481c-980a-fbded9a33e90" released by "_delete_snapshot" :: held 1.964s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.441s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.919s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=610e5760-e9c0-4f7d-99bb-86fd7ea3d571,created_at=2026-07-17T13:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960790921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=610e5760-e9c0-4f7d-99bb-86fd7ea3d571,host='devstack@QuobyteHD#QuobyteHD',id=0e723fba-d486-486a-ba7a-9274167eadbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958ceff8c27d47e4b39e3e382c45724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:37Z,use_quota=True,user_id='7ca166bb030b4e94b202df263b0997c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27f35b36-6ccb-4686-928d-52ca47ec1d80),volume_type_id=27f35b36-6ccb-4686-928d-52ca47ec1d80)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Creating volume 0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:43 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:43 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f8634f7e-a70f-4f70-b7f6-3fc00cfaf492 tempest-GroupSnapshotsTest-1487610488 None] Group tempest-GroupSnapshotsTest-Group-816337066: creating Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cef6d5-568c-4b58-82e1-589ee2bdaec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf', 'volume_size': 2, 'source_volid': '2759511f-16ad-4967-80bb-29b8941733e4', 'source_volstatus': 'available'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:43 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf 1073741824 Jul 17 15:35:43 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2381e1-1f39-4a22-bf01-ef13dd36ae27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=195,cinder:INSERT=48,cinder:UPDATE=211,cinder:DELETE=12 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:35:43 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Volume volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf (c8d11e69-bd27-4173-ac1c-b943e08be5cf): created successfully Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2381e1-1f39-4a22-bf01-ef13dd36ae27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Flow 'volume_create_manager' (553cd1b9-7c90-4b02-9d2f-039134629d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:43 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f8634f7e-a70f-4f70-b7f6-3fc00cfaf492 tempest-GroupSnapshotsTest-1487610488 None] Group tempest-GroupSnapshotsTest-Group-816337066: created successfully Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=194,cinder:UPDATE=203,cinder:INSERT=48,cinder:DELETE=10 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:35:43 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f8634f7e-a70f-4f70-b7f6-3fc00cfaf492 tempest-GroupSnapshotsTest-1487610488 None] Create group completed successfully. Jul 17 15:35:43 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2b01115f-fc40-4a60-a7f3-9d6fb7798b65 tempest-VolumesCloneTest-838544983 None] Created volume successfully. Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Acquiring lock "cinder-c8d11e69-bd27-4173-ac1c-b943e08be5cf-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Lock "cinder-c8d11e69-bd27-4173-ac1c-b943e08be5cf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Acquiring lock "cinder-quobyte-c8d11e69-bd27-4173-ac1c-b943e08be5cf" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Lock "cinder-quobyte-c8d11e69-bd27-4173-ac1c-b943e08be5cf" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aefe0d-de72-4a40-ab57-efd6d9b3504b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:43 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf 1073741824" returned: 0 in 0.664s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:44 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf Jul 17 15:35:44 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:44 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf Jul 17 15:35:44 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:44 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f5321a-e2d3-478c-a6c4-a2589ae580b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e723fba-d486-486a-ba7a-9274167eadbf', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d63c74-6193-4ba2-b7f7-8892a354edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:44 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Volume volume-0e723fba-d486-486a-ba7a-9274167eadbf (0e723fba-d486-486a-ba7a-9274167eadbf): created successfully Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d63c74-6193-4ba2-b7f7-8892a354edef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Flow 'volume_create_manager' (3e166886-3268-4cc8-a1b1-b2e11f9251eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:44 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:44 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d1597ea7-fcdf-4cac-80bd-9dd539ae350a tempest-GroupsV314Test-72423976 None] Created volume successfully. Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf" returned: 0 in 0.475s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:44 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf Jul 17 15:35:44 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:44 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8d11e69-bd27-4173-ac1c-b943e08be5cf" returned: 0 in 0.296s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Lock "cinder-quobyte-c8d11e69-bd27-4173-ac1c-b943e08be5cf" released by "delete_volume" :: held 0.835s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Created reservations ['a823cff9-5fd8-4ad7-981a-8bde48c816aa', '7956a671-1e64-4c1c-8c46-f53ae4499461', '758aa2b2-bc76-46e7-9f57-e34fbdfb3c92', 'e53c329e-4052-4fcb-a519-1968f5ede386'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:45 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:45 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Flow 'volume_create_manager' (62fb4afa-ff09-461c-af01-8d35236385e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b911c8e7-e279-4af6-ae2a-aa98808a58ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b911c8e7-e279-4af6-ae2a-aa98808a58ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1114115346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60b414b1-1ee8-4b2c-8a4c-5f472f197ef1,host='devstack@QuobyteHD#QuobyteHD',id=b92664b7-1e85-4761-855b-4654c4e5ca1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8f89d8d2e48d8a0c6d1d84e051595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:45Z,use_quota=True,user_id='025178bf5071477ba8ab865c943170be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f30ce822-36db-4077-a2c3-24949a7c3d4b),volume_type_id=f30ce822-36db-4077-a2c3-24949a7c3d4b)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd3547c-2e95-4683-8acd-f7d39c3d00ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd3547c-2e95-4683-8acd-f7d39c3d00ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10692b7f-2fd5-4cfa-b359-4fd717352186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10692b7f-2fd5-4cfa-b359-4fd717352186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92664b7-1e85-4761-855b-4654c4e5ca1a', 'volume_name': 'volume-b92664b7-1e85-4761-855b-4654c4e5ca1a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098ecd6e-e5c2-41b2-ba20-9e3a3ea71376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098ecd6e-e5c2-41b2-ba20-9e3a3ea71376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb5daca-9b8d-4f91-8341-d8115a901f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Volume b92664b7-1e85-4761-855b-4654c4e5ca1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92664b7-1e85-4761-855b-4654c4e5ca1a', 'volume_size': 1} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60b414b1-1ee8-4b2c-8a4c-5f472f197ef1,created_at=2026-07-17T13:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1114115346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60b414b1-1ee8-4b2c-8a4c-5f472f197ef1,host='devstack@QuobyteHD#QuobyteHD',id=b92664b7-1e85-4761-855b-4654c4e5ca1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8f89d8d2e48d8a0c6d1d84e051595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:45Z,use_quota=True,user_id='025178bf5071477ba8ab865c943170be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f30ce822-36db-4077-a2c3-24949a7c3d4b),volume_type_id=f30ce822-36db-4077-a2c3-24949a7c3d4b)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Creating volume b92664b7-1e85-4761-855b-4654c4e5ca1a {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:45 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:45 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a 1073741824 Jul 17 15:35:45 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:45 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.472s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Deleted volume successfully. Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Acquiring lock "cinder-2759511f-16ad-4967-80bb-29b8941733e4-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-92e5ef9f-e8a0-4a67-bba6-f29b43960111 tempest-VolumesCloneTest-838544983 None] Lock "cinder-c8d11e69-bd27-4173-ac1c-b943e08be5cf-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Lock "cinder-2759511f-16ad-4967-80bb-29b8941733e4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Acquiring lock "cinder-quobyte-2759511f-16ad-4967-80bb-29b8941733e4" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Lock "cinder-quobyte-2759511f-16ad-4967-80bb-29b8941733e4" acquired by "delete_volume" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05d1fdd-bb0b-4c11-a2c3-46c6fcd02339]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:45 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 Jul 17 15:35:45 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:45 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a 1073741824" returned: 0 in 0.627s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:45 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a Jul 17 15:35:45 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:46 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4" returned: 0 in 0.510s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:46 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:46 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4 Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a" returned: 0 in 0.334s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:46 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.470s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:46 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Cloning volume 0e723fba-d486-486a-ba7a-9274167eadbf to volume 655d9a61-c585-40ed-a528-386fb57707c1 Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb5daca-9b8d-4f91-8341-d8115a901f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92664b7-1e85-4761-855b-4654c4e5ca1a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc3a90f-60d8-4ea7-9bdc-eaec5aa9dd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:46 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Volume volume-b92664b7-1e85-4761-855b-4654c4e5ca1a (b92664b7-1e85-4761-855b-4654c4e5ca1a): created successfully Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc3a90f-60d8-4ea7-9bdc-eaec5aa9dd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Flow 'volume_create_manager' (62fb4afa-ff09-461c-af01-8d35236385e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Creating offline snapshot ffe89f6c-ce22-42ca-8581-f31fe01452b4 of volume 0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:35:46 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8fbd76bb-2f46-440b-a308-dcb2c3a8b2b9 tempest-GroupSnapshotsTest-1487610488 None] Created volume successfully. Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1b1509-f25f-43d8-9c73-e0011d3b344c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:46 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf Jul 17 15:35:46 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:46 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2759511f-16ad-4967-80bb-29b8941733e4" returned: 0 in 0.305s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Lock "cinder-quobyte-2759511f-16ad-4967-80bb-29b8941733e4" released by "delete_volume" :: held 0.908s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Created reservations ['85ab9bb8-8f5a-4116-b8d9-44c6543eebfd', 'f6891d7d-7026-4260-9ee2-fde7a2747cc9', '829933bd-9590-40f4-b411-a84896b584de', 'ff85f24e-9e53-4c30-95e2-14e70428cffc'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:46 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:46 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:46 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] GroupSnapshot 4f3b8466-479b-463c-88ce-e809bba7e744: creating. Jul 17 15:35:46 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf" returned: 0 in 0.539s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Group snapshot 4f3b8466-479b-463c-88ce-e809bba7e744: creating. {{(pid=87769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 15:35:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:46 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 1G Jul 17 15:35:46 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:47 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.342s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:47 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:47 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Deleted volume successfully. Jul 17 15:35:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a240a6de-6782-49c4-ab9f-212012b37923 tempest-VolumesCloneTest-838544983 None] Lock "cinder-2759511f-16ad-4967-80bb-29b8941733e4-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:47 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 1G" returned: 0 in 0.517s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e723fba-d486-486a-ba7a-9274167eadbf -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:47 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e723fba-d486-486a-ba7a-9274167eadbf -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 Jul 17 15:35:47 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:47 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e723fba-d486-486a-ba7a-9274167eadbf -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4" returned: 0 in 0.319s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:47 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:47 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 Jul 17 15:35:47 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:48 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4" returned: 0 in 0.314s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:48 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.info Jul 17 15:35:48 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:48 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.info" returned: 0 in 0.312s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:48 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:48 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.info Jul 17 15:35:48 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:48 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.info" returned: 0 in 0.312s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Acquiring lock "cinder-quobyte-655d9a61-c585-40ed-a528-386fb57707c1" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Lock "cinder-quobyte-655d9a61-c585-40ed-a528-386fb57707c1" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] snapshot: ffe89f6c-ce22-42ca-8581-f31fe01452b4, volume: 655d9a61-c585-40ed-a528-386fb57707c1, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaa42af-5984-466e-a85e-88ef12a6ce5d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:48 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 Jul 17 15:35:48 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:49 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4" returned: 0 in 0.443s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e723fba-d486-486a-ba7a-9274167eadbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:35:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:35:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:35:49 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e177cbb-65e4-4c42-a811-4a8f81dbb8f7]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:49 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf Jul 17 15:35:49 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:49 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf" returned: 0 in 0.441s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:49 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:35:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:49 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 Jul 17 15:35:49 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Flow 'volume_create_manager' (5cd0d28e-d78a-47c7-b505-4b3b7a09ac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccee35f4-71b3-460a-aae8-de4cfd0774e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccee35f4-71b3-460a-aae8-de4cfd0774e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-774646022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af74abf-bcb1-445a-a7a3-8036167d2c9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18c5a30a70b34050aa9d1fb341e9c7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:50Z,use_quota=True,user_id='938eb1969258499cb9848db570e3709d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9a2260-5c09-4000-962d-06db7e9d15ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9a2260-5c09-4000-962d-06db7e9d15ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7a3a90-fcbf-4079-9ff2-c9cb99b680df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7a3a90-fcbf-4079-9ff2-c9cb99b680df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af74abf-bcb1-445a-a7a3-8036167d2c9c', 'volume_name': 'volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dafd701-d97f-4473-a681-c1cd32f23b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dafd701-d97f-4473-a681-c1cd32f23b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1415f5e6-6711-4912-8134-25e546e18e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Volume 9af74abf-bcb1-445a-a7a3-8036167d2c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c', 'volume_size': 1} Jul 17 15:35:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:52 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:35:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Flow 'volume_create_manager' (0b1d3047-08ab-4097-878c-56de7d5c8e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cb7dfe-53b0-41b0-b308-fc7908739359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cb7dfe-53b0-41b0-b308-fc7908739359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58215cab-199e-474f-a3c0-e133b5002267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb1d287476b449e395f6f7b86ce9f716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:52Z,use_quota=True,user_id='32f5904d208e467c89316121daa340d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b39f86a-fe79-4449-8bbf-307c00429762),volume_type_id=2b39f86a-fe79-4449-8bbf-307c00429762)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ed87e4-b85d-4de9-af76-e7cdb72e6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ed87e4-b85d-4de9-af76-e7cdb72e6986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352c7ecf-65ce-46db-8038-2a246376f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:52 devstack cinder-volume[87769]: DEBUG cinder.image.glance [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Creating Keystone auth plugin from conf {{(pid=87769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 15:35:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352c7ecf-65ce-46db-8038-2a246376f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58215cab-199e-474f-a3c0-e133b5002267', 'volume_name': 'volume-58215cab-199e-474f-a3c0-e133b5002267', 'volume_size': 1, 'image_id': '3c6cea1c-8807-439a-b5de-212fd66bf19a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c6cea1c-8807-439a-b5de-212fd66bf19a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c218b5c0006e99eba3f1c0e708b324e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb1d287476b449e395f6f7b86ce9f716', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e88d859cfab45017c94162244a42e757e9792ecfc523c356998621756ad5686f6a84f8388d881bf45580b8091832f52e53ef32bed900275aef40b32aa08438e6', 'id': '3c6cea1c-8807-439a-b5de-212fd66bf19a', 'created_at': datetime.datetime(2026, 7, 17, 13, 35, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c6cea1c-8807-439a-b5de-212fd66bf19a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c6b564-d269-4ded-b468-573a77941739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c6b564-d269-4ded-b468-573a77941739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb5ba7f-2f09-4c75-afce-94e0ca9c8704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:53 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Volume 58215cab-199e-474f-a3c0-e133b5002267: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58215cab-199e-474f-a3c0-e133b5002267', 'volume_size': 1, 'image_id': '3c6cea1c-8807-439a-b5de-212fd66bf19a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c6cea1c-8807-439a-b5de-212fd66bf19a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c218b5c0006e99eba3f1c0e708b324e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb1d287476b449e395f6f7b86ce9f716', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e88d859cfab45017c94162244a42e757e9792ecfc523c356998621756ad5686f6a84f8388d881bf45580b8091832f52e53ef32bed900275aef40b32aa08438e6', 'id': '3c6cea1c-8807-439a-b5de-212fd66bf19a', 'created_at': datetime.datetime(2026, 7, 17, 13, 35, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c6cea1c-8807-439a-b5de-212fd66bf19a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 15:35:53 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Trying to clone 58215cab-199e-474f-a3c0-e133b5002267 from image 3c6cea1c-8807-439a-b5de-212fd66bf19a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c6cea1c-8807-439a-b5de-212fd66bf19a', 'metadata': {}}]). {{(pid=87769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 15:35:53 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 15:35:53 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Image download 0.00 MB at 0.00 MB/s Jul 17 15:35:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[db866394-b0dd-492d-a8f6-425d7c832230]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:54 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD Jul 17 15:35:54 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:54 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:54 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD Jul 17 15:35:54 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:54 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1" returned: 0 in 5.136s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae19c6b2-ce5d-4497-83b0-cf9b56624dbd]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:54 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf Jul 17 15:35:54 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:55 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Temporary image 3c6cea1c-8807-439a-b5de-212fd66bf19a is fetched for user 32f5904d208e467c89316121daa340d6. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4e99e4-3210-4adb-bcf9-77fbc4fcdb79]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:55 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD Jul 17 15:35:55 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:55 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf" returned: 0 in 0.548s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:35:55 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Converted 1024.00 MB image at 199.31 MB/s Jul 17 15:35:55 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:55 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 Jul 17 15:35:55 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:55 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:55 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD Jul 17 15:35:55 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:55 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1" returned: 0 in 0.249s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Lock "cinder-quobyte-655d9a61-c585-40ed-a528-386fb57707c1" released by "_copy_volume_from_snapshot" :: held 6.920s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Acquiring lock "cinder-quobyte-ffe89f6c-ce22-42ca-8581-f31fe01452b4" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Lock "cinder-quobyte-ffe89f6c-ce22-42ca-8581-f31fe01452b4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Deleting offline snapshot ffe89f6c-ce22-42ca-8581-f31fe01452b4 of volume 0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] snapshot_file for this snap is: volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e73d8-b8da-4dfa-9201-7f51a9755226]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:55 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:35:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:55 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 Jul 17 15:35:55 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:56 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4" returned: 0 in 0.362s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e723fba-d486-486a-ba7a-9274167eadbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:35:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1bab80-3945-40ef-8fd2-31ba190eccc0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:56 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf Jul 17 15:35:56 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:56 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf" returned: 0 in 0.353s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:56 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 Jul 17 15:35:56 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:56 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4" returned: 0 in 0.330s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:56 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4 Jul 17 15:35:56 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:57 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf.ffe89f6c-ce22-42ca-8581-f31fe01452b4" returned: 0 in 0.242s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Lock "cinder-quobyte-ffe89f6c-ce22-42ca-8581-f31fe01452b4" released by "_delete_snapshot" :: held 1.378s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.847s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.158s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Creating offline snapshot 8d3a8c3b-58f1-4fbf-bcb5-61fad971806a of volume b92664b7-1e85-4761-855b-4654c4e5ca1a {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f57bad-b93c-43dc-a2be-04f7b68c777b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:57 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9e63a907-09a6-4d23-a895-349338435343 tempest-GroupsV314Test-72423976 None] Create group from source-group-610e5760-e9c0-4f7d-99bb-86fd7ea3d571 completed successfully. Jul 17 15:35:57 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a Jul 17 15:35:57 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:57 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a" returned: 0 in 0.360s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:57 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a 1G Jul 17 15:35:57 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Acquiring lock "cinder-quobyte-655d9a61-c585-40ed-a528-386fb57707c1" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Lock "cinder-quobyte-655d9a61-c585-40ed-a528-386fb57707c1" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[203f4f1d-be33-4ec8-b113-9552f6a0c4f9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:57 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 Jul 17 15:35:57 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:57 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a 1G" returned: 0 in 0.449s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b92664b7-1e85-4761-855b-4654c4e5ca1a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:57 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b92664b7-1e85-4761-855b-4654c4e5ca1a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a Jul 17 15:35:57 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:58 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1" returned: 0 in 0.381s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:58 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1 Jul 17 15:35:58 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:58 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b92664b7-1e85-4761-855b-4654c4e5ca1a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a" returned: 0 in 0.314s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:58 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:58 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a Jul 17 15:35:58 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:58 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-655d9a61-c585-40ed-a528-386fb57707c1" returned: 0 in 0.266s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Lock "cinder-quobyte-655d9a61-c585-40ed-a528-386fb57707c1" released by "delete_volume" :: held 0.703s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Created reservations ['905d3e40-cf69-4b66-aadc-2806457233f6'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:58 devstack cinder-volume[87769]: WARNING cinder.quota [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2144621146 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2144621146, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:58 devstack cinder-volume[87769]: WARNING cinder.quota [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2144621146 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2144621146, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Created reservations ['95c9a8f1-6fc9-4ff5-912c-0a81f2aab74b', 'e0310111-4ee9-43aa-aea3-38fe8cee4be0', '0aaae5b7-00b8-41f0-be06-79cf4f9c3d80', 'b672ae94-00b9-41cc-b5aa-91f83fa87253'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:35:58 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a" returned: 0 in 0.266s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:58 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.info Jul 17 15:35:58 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:58 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:35:58 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:58 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.info" returned: 0 in 0.259s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:58 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:58 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.info Jul 17 15:35:58 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:58 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:58 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:35:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-55da1e6b-7b83-4070-bc45-5923a413b7cb tempest-GroupsV314Test-72423976 None] Delete group completed successfully. Jul 17 15:35:59 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.info" returned: 0 in 0.269s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.751s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-774646022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af74abf-bcb1-445a-a7a3-8036167d2c9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18c5a30a70b34050aa9d1fb341e9c7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:50Z,use_quota=True,user_id='938eb1969258499cb9848db570e3709d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Creating volume 9af74abf-bcb1-445a-a7a3-8036167d2c9c {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:59 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:59 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c 1073741824 Jul 17 15:35:59 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Acquiring lock "cinder-quobyte-0e723fba-d486-486a-ba7a-9274167eadbf" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Lock "cinder-quobyte-0e723fba-d486-486a-ba7a-9274167eadbf" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbb3f57-0b53-4994-9cdf-041ef80dc249]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0e3bde7e-79f7-412c-b7c7-937e49088ea9 tempest-GroupSnapshotsTest-1487610488 None] group_snapshot 4f3b8466-479b-463c-88ce-e809bba7e744: created successfully Jul 17 15:35:59 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf Jul 17 15:35:59 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:59 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c 1073741824" returned: 0 in 0.439s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:59 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c Jul 17 15:35:59 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:59 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf" returned: 0 in 0.399s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:59 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf Jul 17 15:35:59 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:59 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.027s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58215cab-199e-474f-a3c0-e133b5002267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb1d287476b449e395f6f7b86ce9f716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:35:52Z,use_quota=True,user_id='32f5904d208e467c89316121daa340d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b39f86a-fe79-4449-8bbf-307c00429762),volume_type_id=2b39f86a-fe79-4449-8bbf-307c00429762)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Creating volume 58215cab-199e-474f-a3c0-e133b5002267 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:35:59 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1415f5e6-6711-4912-8134-25e546e18e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79c607d-3488-4fe0-a80c-c7640aa80581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:35:59 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0e723fba-d486-486a-ba7a-9274167eadbf" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:35:59 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 1073741824 Jul 17 15:35:59 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:35:59 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Volume volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c (9af74abf-bcb1-445a-a7a3-8036167d2c9c): created successfully Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79c607d-3488-4fe0-a80c-c7640aa80581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Flow 'volume_create_manager' (5cd0d28e-d78a-47c7-b505-4b3b7a09ac6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:35:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Lock "cinder-quobyte-0e723fba-d486-486a-ba7a-9274167eadbf" released by "delete_volume" :: held 0.767s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:35:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a7f3a79b-5b8f-47c2-90da-e37a23920595 tempest-VolumesListTestJSON-1802226977 None] Created volume successfully. Jul 17 15:36:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] group_snapshot 4f3b8466-479b-463c-88ce-e809bba7e744: deleting Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] group_snapshot 4f3b8466-479b-463c-88ce-e809bba7e744: deleting {{(pid=87769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Created reservations ['10477f73-db4b-4cda-9800-349d174a4f4d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-b92664b7-1e85-4761-855b-4654c4e5ca1a" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-b92664b7-1e85-4761-855b-4654c4e5ca1a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-8d3a8c3b-58f1-4fbf-bcb5-61fad971806a" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8d3a8c3b-58f1-4fbf-bcb5-61fad971806a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Deleting offline snapshot 8d3a8c3b-58f1-4fbf-bcb5-61fad971806a of volume b92664b7-1e85-4761-855b-4654c4e5ca1a {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] snapshot_file for this snap is: volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[821b10eb-ff99-4549-a4c6-827ddbe387f4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Created reservations ['04b849e1-30ee-400b-9da7-bad88b3ed118', '7b44163c-49f6-438d-a545-83343ea9f098', 'd8e94f0c-c0ec-4e19-a73e-651ddedfce98', '21f919eb-4fb9-4644-8321-0b9ce88cf983'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:00 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a Jul 17 15:36:00 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:00 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:00 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:00 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 1073741824" returned: 0 in 0.623s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:00 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 Jul 17 15:36:00 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:00 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a" returned: 0 in 0.437s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b92664b7-1e85-4761-855b-4654c4e5ca1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cf40ac-885c-4182-8af7-d9ad088e70f9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:00 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.347s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-466d5a20-2971-42ee-96de-aeb44326e449 tempest-GroupsV314Test-72423976 None] Delete group completed successfully. Jul 17 15:36:00 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a Jul 17 15:36:00 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:00 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267" returned: 0 in 0.372s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Flow 'volume_create_manager' (2fda3a94-2bf8-4784-9b89-88872c2e65b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd954f90-8813-482b-9bf1-59f3ee65ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Attempting download of 3c6cea1c-8807-439a-b5de-212fd66bf19a ((None, [{'url': 'file:///opt/stack/data/glance/images/3c6cea1c-8807-439a-b5de-212fd66bf19a', 'metadata': {}}])) to volume 58215cab-199e-474f-a3c0-e133b5002267. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd954f90-8813-482b-9bf1-59f3ee65ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-305307795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb097f17-5697-4625-b97e-af08fcdb58cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18c5a30a70b34050aa9d1fb341e9c7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:01Z,use_quota=True,user_id='938eb1969258499cb9848db570e3709d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4edc058-149a-4139-8e40-20bfa1f4e971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4edc058-149a-4139-8e40-20bfa1f4e971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ce6512-bd7e-4dad-8217-242889132e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ce6512-bd7e-4dad-8217-242889132e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb097f17-5697-4625-b97e-af08fcdb58cc', 'volume_name': 'volume-eb097f17-5697-4625-b97e-af08fcdb58cc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167da306-7d10-43d0-babc-21ab5fb00c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167da306-7d10-43d0-babc-21ab5fb00c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411ab8aa-0a73-4652-897d-a0179996b329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:01 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Volume eb097f17-5697-4625-b97e-af08fcdb58cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb097f17-5697-4625-b97e-af08fcdb58cc', 'volume_size': 1} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-305307795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb097f17-5697-4625-b97e-af08fcdb58cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18c5a30a70b34050aa9d1fb341e9c7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:01Z,use_quota=True,user_id='938eb1969258499cb9848db570e3709d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Creating volume eb097f17-5697-4625-b97e-af08fcdb58cc {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:01 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:01 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a" returned: 0 in 0.446s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:01 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc 1073741824 Jul 17 15:36:01 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d13db02-9fcd-4f7e-bf4a-cf588fa1a5aa]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c6cea1c-8807-439a-b5de-212fd66bf19a_qdr7c_u4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:01 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a Jul 17 15:36:01 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:01 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c6cea1c-8807-439a-b5de-212fd66bf19a_qdr7c_u4 Jul 17 15:36:01 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:01 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a" returned: 0 in 0.393s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:01 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c6cea1c-8807-439a-b5de-212fd66bf19a_qdr7c_u4" returned: 0 in 0.383s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c6cea1c-8807-439a-b5de-212fd66bf19a_qdr7c_u4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:01 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a Jul 17 15:36:01 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:01 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc 1073741824" returned: 0 in 0.550s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:01 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c6cea1c-8807-439a-b5de-212fd66bf19a_qdr7c_u4 Jul 17 15:36:01 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:01 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc Jul 17 15:36:01 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:01 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a.8d3a8c3b-58f1-4fbf-bcb5-61fad971806a" returned: 0 in 0.305s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-8d3a8c3b-58f1-4fbf-bcb5-61fad971806a" released by "_delete_snapshot" :: held 1.731s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-b92664b7-1e85-4761-855b-4654c4e5ca1a" released by "delete_snapshot" :: held 1.767s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:01 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c6cea1c-8807-439a-b5de-212fd66bf19a_qdr7c_u4" returned: 1 in 0.422s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c6cea1c-8807-439a-b5de-212fd66bf19a_qdr7c_u4' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f516bc-d145-4563-9d37-ddc1a4b9ebb4]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:01 devstack cinder-volume[87769]: WARNING cinder.quota [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1456486788 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1456486788, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:36:01 devstack cinder-volume[87769]: WARNING cinder.quota [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1456486788 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1456486788, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:36:01 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:01 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['8a4d67b9-0c14-4e27-876f-fc2dde43d530', 'f92ef360-2ca4-490b-a23e-6c81b8a9f552', 'd48333b6-8372-4bb1-8927-b29bb05ca81b', '7d03f9da-51e0-488d-8e2f-c2872e35c044'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411ab8aa-0a73-4652-897d-a0179996b329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb097f17-5697-4625-b97e-af08fcdb58cc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaec28b-d238-449f-a02f-c8794c8afe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:02 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Volume volume-eb097f17-5697-4625-b97e-af08fcdb58cc (eb097f17-5697-4625-b97e-af08fcdb58cc): created successfully Jul 17 15:36:02 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD Jul 17 15:36:02 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaec28b-d238-449f-a02f-c8794c8afe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Flow 'volume_create_manager' (2fda3a94-2bf8-4784-9b89-88872c2e65b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-990f3305-b2b8-41f6-bb48-bdd2d40af913 tempest-VolumesListTestJSON-1802226977 None] Created volume successfully. Jul 17 15:36:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-32d0a08c-475c-4875-a146-7913d93a203b tempest-GroupSnapshotsTest-1487610488 None] group_snapshot 4f3b8466-479b-463c-88ce-e809bba7e744: deleted successfully Jul 17 15:36:02 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:02 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD Jul 17 15:36:02 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:02 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] 3c6cea1c-8807-439a-b5de-212fd66bf19a was raw, converting to qcow2 {{(pid=87769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:02 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 Jul 17 15:36:02 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "cinder-quobyte-b92664b7-1e85-4761-855b-4654c4e5ca1a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-b92664b7-1e85-4761-855b-4654c4e5ca1a" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d824045f-ab3c-4c3c-9b0c-767e771d28ed]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:02 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a Jul 17 15:36:02 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:03 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267" returned: 0 in 0.623s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c6cea1c-8807-439a-b5de-212fd66bf19a_jk0022jedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:36:03 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:03 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 1G Jul 17 15:36:03 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:03 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a" returned: 0 in 0.495s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:03 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a Jul 17 15:36:03 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:03 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b92664b7-1e85-4761-855b-4654c4e5ca1a" returned: 0 in 0.347s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Lock "cinder-quobyte-b92664b7-1e85-4761-855b-4654c4e5ca1a" released by "delete_volume" :: held 0.933s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:03 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Flow 'volume_create_manager' (df54e56e-d6ef-4edb-b332-ae33079c0ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246732bf-005d-4b14-8e10-ab44e6289ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 1G" returned: 0 in 0.550s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Downloaded image 3c6cea1c-8807-439a-b5de-212fd66bf19a ((None, [{'url': 'file:///opt/stack/data/glance/images/3c6cea1c-8807-439a-b5de-212fd66bf19a', 'metadata': {}}])) to volume 58215cab-199e-474f-a3c0-e133b5002267 successfully. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Temporary image 3c6cea1c-8807-439a-b5de-212fd66bf19a for user 32f5904d208e467c89316121daa340d6 is deleted. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Marking volume 58215cab-199e-474f-a3c0-e133b5002267 as bootable. {{(pid=87769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246732bf-005d-4b14-8e10-ab44e6289ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1805525663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f295e93-cf46-45a6-b501-5bd4994b714c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18c5a30a70b34050aa9d1fb341e9c7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:04Z,use_quota=True,user_id='938eb1969258499cb9848db570e3709d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139b0694-5684-472f-8881-4241661ffef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139b0694-5684-472f-8881-4241661ffef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62cce47-7ab8-4f2c-a683-dbf914ba68aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62cce47-7ab8-4f2c-a683-dbf914ba68aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f295e93-cf46-45a6-b501-5bd4994b714c', 'volume_name': 'volume-4f295e93-cf46-45a6-b501-5bd4994b714c', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2393ef22-ddd9-4f7a-a2c1-781b5e2771de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2393ef22-ddd9-4f7a-a2c1-781b5e2771de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58ccec8-b312-409b-bb7a-045b29ac2528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:03 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Volume 4f295e93-cf46-45a6-b501-5bd4994b714c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f295e93-cf46-45a6-b501-5bd4994b714c', 'volume_size': 1} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1805525663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f295e93-cf46-45a6-b501-5bd4994b714c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18c5a30a70b34050aa9d1fb341e9c7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:04Z,use_quota=True,user_id='938eb1969258499cb9848db570e3709d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Creating volume 4f295e93-cf46-45a6-b501-5bd4994b714c {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:03 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:03 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c 1073741824 Jul 17 15:36:03 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Copying metadata from image 3c6cea1c-8807-439a-b5de-212fd66bf19a to 58215cab-199e-474f-a3c0-e133b5002267. {{(pid=87769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Creating volume glance metadata for volume 58215cab-199e-474f-a3c0-e133b5002267 backed by image 3c6cea1c-8807-439a-b5de-212fd66bf19a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3c6cea1c-8807-439a-b5de-212fd66bf19a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c218b5c0006e99eba3f1c0e708b324e4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 15:36:03 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['29bc602f-31dc-4a5e-ba36-591f6562ee9b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:04 devstack cinder-volume[87769]: WARNING cinder.quota [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1456486788 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1456486788, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb5ba7f-2f09-4c75-afce-94e0ca9c8704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58215cab-199e-474f-a3c0-e133b5002267', 'volume_size': 1, 'image_id': '3c6cea1c-8807-439a-b5de-212fd66bf19a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c6cea1c-8807-439a-b5de-212fd66bf19a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c218b5c0006e99eba3f1c0e708b324e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb1d287476b449e395f6f7b86ce9f716', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e88d859cfab45017c94162244a42e757e9792ecfc523c356998621756ad5686f6a84f8388d881bf45580b8091832f52e53ef32bed900275aef40b32aa08438e6', 'id': '3c6cea1c-8807-439a-b5de-212fd66bf19a', 'created_at': datetime.datetime(2026, 7, 17, 13, 35, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c6cea1c-8807-439a-b5de-212fd66bf19a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08da517e-0a08-4285-ae1f-dd45ecacdb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:04 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Volume volume-58215cab-199e-474f-a3c0-e133b5002267 (58215cab-199e-474f-a3c0-e133b5002267): created successfully Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08da517e-0a08-4285-ae1f-dd45ecacdb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Flow 'volume_create_manager' (0b1d3047-08ab-4097-878c-56de7d5c8e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Created reservations ['2aa3cbda-45e7-4a02-96d8-7957ba5c723f', '6426db66-2c14-4bc5-b969-f8e96bbb5452', '7bb93a2a-79b7-4a8d-b7db-a0f3c55e04c6', '661d089e-6420-4afc-a63a-bc617e72d2f4'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0822eacf-d620-436f-aeb4-fa5dc128ff0e tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Created volume successfully. Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:04 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:04 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Acquiring lock "cinder-58215cab-199e-474f-a3c0-e133b5002267-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "cinder-58215cab-199e-474f-a3c0-e133b5002267-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Acquiring lock "cinder-quobyte-58215cab-199e-474f-a3c0-e133b5002267" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "cinder-quobyte-58215cab-199e-474f-a3c0-e133b5002267" acquired by "delete_volume" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:04 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c 1073741824" returned: 0 in 0.568s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a23453-1d26-47df-a748-742bd8c77d77]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:04 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.366s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:04 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c Jul 17 15:36:04 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-20dbe515-80d9-40d4-8c12-96b52726a06b tempest-GroupSnapshotsTest-1487610488 None] Delete group completed successfully. Jul 17 15:36:04 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 Jul 17 15:36:04 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:04 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c" returned: 0 in 0.298s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58ccec8-b312-409b-bb7a-045b29ac2528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f295e93-cf46-45a6-b501-5bd4994b714c', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feda55f4-afad-4dff-9cc0-71e9e065677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:04 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Volume volume-4f295e93-cf46-45a6-b501-5bd4994b714c (4f295e93-cf46-45a6-b501-5bd4994b714c): created successfully Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feda55f4-afad-4dff-9cc0-71e9e065677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Flow 'volume_create_manager' (df54e56e-d6ef-4edb-b332-ae33079c0ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:04 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267" returned: 0 in 0.403s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8f9974f4-17ad-4b7c-a875-1de600ff5e86 tempest-VolumesListTestJSON-1802226977 None] Created volume successfully. Jul 17 15:36:04 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267 Jul 17 15:36:04 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:05 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58215cab-199e-474f-a3c0-e133b5002267" returned: 0 in 0.256s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "cinder-quobyte-58215cab-199e-474f-a3c0-e133b5002267" released by "delete_volume" :: held 0.716s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:05 devstack cinder-volume[87769]: WARNING cinder.quota [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:36:05 devstack cinder-volume[87769]: WARNING cinder.quota [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Created reservations ['919e8a67-e324-4548-9fd7-06fff2319a41', 'c83cc524-e31f-4b88-988f-ceded1bf8401', 'd3ef8b8f-45db-40a6-a5eb-fa560cfeb003', 'b53e4b06-4f38-4178-acdb-9b0520b55c65'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:05 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:05 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:05 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.319s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:05 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Deleted volume successfully. Jul 17 15:36:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-62881044-f94a-40a2-83ad-7d721145d117 tempest-VolumeAndVolumeTypeFromImageTest-2081430193 None] Lock "cinder-58215cab-199e-474f-a3c0-e133b5002267-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "cinder-4f295e93-cf46-45a6-b501-5bd4994b714c-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-4f295e93-cf46-45a6-b501-5bd4994b714c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "cinder-quobyte-4f295e93-cf46-45a6-b501-5bd4994b714c" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-quobyte-4f295e93-cf46-45a6-b501-5bd4994b714c" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:09 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83cfe73-edcd-47bb-b997-ccaf34247281]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:09 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c Jul 17 15:36:09 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:09 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c" returned: 0 in 0.518s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:09 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c Jul 17 15:36:09 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:10 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4f295e93-cf46-45a6-b501-5bd4994b714c" returned: 0 in 0.299s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-quobyte-4f295e93-cf46-45a6-b501-5bd4994b714c" released by "delete_volume" :: held 0.885s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Created reservations ['33249b59-abc1-47ee-8f75-b8c049d372e4', 'e51784f8-431d-47cd-93ce-54aebb591779', 'a1ad73f2-92e5-4369-8d3c-393a8f5be6d7', '844c0ea8-7095-4730-8f0e-cbe33ec1401c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:10 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:10 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "cinder-eb097f17-5697-4625-b97e-af08fcdb58cc-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-eb097f17-5697-4625-b97e-af08fcdb58cc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "cinder-quobyte-eb097f17-5697-4625-b97e-af08fcdb58cc" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-quobyte-eb097f17-5697-4625-b97e-af08fcdb58cc" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f92d7-107a-43a8-a325-8c6b9324b7d4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:10 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.463s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:10 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Deleted volume successfully. Jul 17 15:36:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b603c186-9fbb-4806-88aa-dfde68bceb74 tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-4f295e93-cf46-45a6-b501-5bd4994b714c-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:10 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc Jul 17 15:36:10 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:11 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc" returned: 0 in 0.478s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:11 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc Jul 17 15:36:11 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:11 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-eb097f17-5697-4625-b97e-af08fcdb58cc" returned: 0 in 0.294s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-quobyte-eb097f17-5697-4625-b97e-af08fcdb58cc" released by "delete_volume" :: held 0.843s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Created reservations ['452251e9-0d07-4502-a905-398922e4e6b7', '50102c5d-42ab-43b8-a967-65d8b7a25c78', '9061a400-a9df-4785-bae8-aaecc8e6326e', 'b60f1da3-aefe-4d1a-b845-d1acbade3601'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:11 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:11 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "cinder-9af74abf-bcb1-445a-a7a3-8036167d2c9c-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-9af74abf-bcb1-445a-a7a3-8036167d2c9c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "cinder-quobyte-9af74abf-bcb1-445a-a7a3-8036167d2c9c" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:11 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-quobyte-9af74abf-bcb1-445a-a7a3-8036167d2c9c" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.345s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Deleted volume successfully. Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[060cf484-8ae1-4825-8e5a-8b34a53ca6e4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6d067b5b-61d7-4eaa-a9d6-f6b42f245fdd tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-eb097f17-5697-4625-b97e-af08fcdb58cc-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:12 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c Jul 17 15:36:12 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:12 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c" returned: 0 in 0.424s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:12 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c Jul 17 15:36:12 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Flow 'volume_create_manager' (748faa17-eb84-4c39-9d61-d95b927c26c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1d7b89-91db-47db-9b77-d488fd8c0931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:12 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1d7b89-91db-47db-9b77-d488fd8c0931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1500744169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4652c249-52c2-437f-bab2-c131863bb875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9354abbaf3a24b809c265383be15552c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:13Z,use_quota=True,user_id='488c1677d33c48cbb11c162497d3bee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414d29e9-7fca-4cd0-9d78-0b5a7918f9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414d29e9-7fca-4cd0-9d78-0b5a7918f9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565d9caa-647b-472d-9c32-26b536415bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565d9caa-647b-472d-9c32-26b536415bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4652c249-52c2-437f-bab2-c131863bb875', 'volume_name': 'volume-4652c249-52c2-437f-bab2-c131863bb875', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a7bbd4-50f5-4bf3-8bd8-84465129caee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a7bbd4-50f5-4bf3-8bd8-84465129caee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5fd58c-6c03-4902-986a-73c3700ef4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:12 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Volume 4652c249-52c2-437f-bab2-c131863bb875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4652c249-52c2-437f-bab2-c131863bb875', 'volume_size': 1} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1500744169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4652c249-52c2-437f-bab2-c131863bb875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9354abbaf3a24b809c265383be15552c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:13Z,use_quota=True,user_id='488c1677d33c48cbb11c162497d3bee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Creating volume 4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:12 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9af74abf-bcb1-445a-a7a3-8036167d2c9c" returned: 0 in 0.475s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-quobyte-9af74abf-bcb1-445a-a7a3-8036167d2c9c" released by "delete_volume" :: held 0.959s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:12 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 1073741824 Jul 17 15:36:12 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:12 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Created reservations ['89f943d9-26ae-4ee6-bdd1-af79ae39e631', '6f3dd869-48de-49e1-bab6-6a4488b3c5e2', 'fb573b5b-39b8-4c1e-8308-24261530cf81', '95767ced-b205-43eb-9137-89672677e24c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:13 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:13 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:13 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-25d00da3-4629-4bbf-956b-4afa85de9856 tempest-GroupsTest-1586350207 None] Group tempest-Group1-2124620128: creating Jul 17 15:36:13 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-25d00da3-4629-4bbf-956b-4afa85de9856 tempest-GroupsTest-1586350207 None] Group tempest-Group1-2124620128: created successfully Jul 17 15:36:13 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-25d00da3-4629-4bbf-956b-4afa85de9856 tempest-GroupsTest-1586350207 None] Create group completed successfully. Jul 17 15:36:13 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.307s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:13 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Deleted volume successfully. Jul 17 15:36:13 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 1073741824" returned: 0 in 0.537s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bd1958fb-18fc-4ce7-b675-e3edf0c4c238 tempest-VolumesListTestJSON-1802226977 None] Lock "cinder-9af74abf-bcb1-445a-a7a3-8036167d2c9c-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:13 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 Jul 17 15:36:13 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:13 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875" returned: 0 in 0.268s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5fd58c-6c03-4902-986a-73c3700ef4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4652c249-52c2-437f-bab2-c131863bb875', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e99d568-cccc-4728-b52d-4b9d123559ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:13 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Volume volume-4652c249-52c2-437f-bab2-c131863bb875 (4652c249-52c2-437f-bab2-c131863bb875): created successfully Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e99d568-cccc-4728-b52d-4b9d123559ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:13 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Flow 'volume_create_manager' (748faa17-eb84-4c39-9d61-d95b927c26c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:13 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-05fa733b-eba6-4bbe-b8ae-164d20a5e9c0 tempest-VolumeDependencyTests-1801168983 None] Created volume successfully. Jul 17 15:36:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-99e79ec9-eb92-476e-a32a-80f9f5949b43 tempest-GroupsTest-1586350207 None] Group tempest-Group2-1455372795: creating Jul 17 15:36:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-99e79ec9-eb92-476e-a32a-80f9f5949b43 tempest-GroupsTest-1586350207 None] Group tempest-Group2-1455372795: created successfully Jul 17 15:36:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-99e79ec9-eb92-476e-a32a-80f9f5949b43 tempest-GroupsTest-1586350207 None] Create group completed successfully. Jul 17 15:36:14 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:14 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Flow 'volume_create_manager' (a16ae9ed-87ca-4566-b967-db5106de1872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:14 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83585cb2-41a4-4f7e-8e4f-53a8f19cc613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:14 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83585cb2-41a4-4f7e-8e4f-53a8f19cc613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-567638914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d72855-4d4c-4c94-bed8-092e6011d2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e49ac6d8fb498d89cc300f0d1c0507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:15Z,use_quota=True,user_id='3d23e54493bf469db0a1d8be5a04f00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a75e75a-9d69-485d-978a-f82bcdcdabe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a75e75a-9d69-485d-978a-f82bcdcdabe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3b8163-7108-4d48-af91-07bf1e19877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3b8163-7108-4d48-af91-07bf1e19877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d72855-4d4c-4c94-bed8-092e6011d2ec', 'volume_name': 'volume-84d72855-4d4c-4c94-bed8-092e6011d2ec', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358cb104-c416-4c0a-9cdb-4fbb65c4b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358cb104-c416-4c0a-9cdb-4fbb65c4b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc069627-03c8-4f5c-8cd0-b4678924f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:15 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Volume 84d72855-4d4c-4c94-bed8-092e6011d2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d72855-4d4c-4c94-bed8-092e6011d2ec', 'volume_size': 1} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-567638914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d72855-4d4c-4c94-bed8-092e6011d2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e49ac6d8fb498d89cc300f0d1c0507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:15Z,use_quota=True,user_id='3d23e54493bf469db0a1d8be5a04f00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Creating volume 84d72855-4d4c-4c94-bed8-092e6011d2ec {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:15 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:15 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec 1073741824 Jul 17 15:36:15 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:15 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec 1073741824" returned: 0 in 0.489s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:15 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec Jul 17 15:36:15 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:15 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec" returned: 0 in 0.321s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.815s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc069627-03c8-4f5c-8cd0-b4678924f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d72855-4d4c-4c94-bed8-092e6011d2ec', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71498129-c323-4d4c-99e3-5613c7191d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Creating offline snapshot 677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 of volume 4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:36:15 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Volume volume-84d72855-4d4c-4c94-bed8-092e6011d2ec (84d72855-4d4c-4c94-bed8-092e6011d2ec): created successfully Jul 17 15:36:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71498129-c323-4d4c-99e3-5613c7191d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Flow 'volume_create_manager' (a16ae9ed-87ca-4566-b967-db5106de1872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a87d66-1a25-4d0f-8c85-9e7743a4365f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-408a9031-2699-4593-9cda-ac9e9d3b6071 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Created volume successfully. Jul 17 15:36:16 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 Jul 17 15:36:16 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Flow 'volume_create_manager' (5dd84ad9-df6e-4132-b1da-e097fc28664e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe59430-733a-4ccf-ba3a-e2ef34e43377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe59430-733a-4ccf-ba3a-e2ef34e43377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1198104230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4df3c48a-3f93-453b-8b16-cb771fce66b7,host='devstack@QuobyteHD#QuobyteHD',id=0c3de801-c18f-4197-adc7-54db83a145d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d60141ed31d46bf8684933a53905673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:16Z,use_quota=True,user_id='9af66eec718444f7ad281422e32aec81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a5dfc4d-d689-4bab-8342-695f1679a695),volume_type_id=3a5dfc4d-d689-4bab-8342-695f1679a695)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd4d6ed-5110-4645-a44c-74b18f81b50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd4d6ed-5110-4645-a44c-74b18f81b50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02fa134b-0691-4b50-9532-dba56f8ba986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02fa134b-0691-4b50-9532-dba56f8ba986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3de801-c18f-4197-adc7-54db83a145d8', 'volume_name': 'volume-0c3de801-c18f-4197-adc7-54db83a145d8', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be20ec3-6e19-46d3-bf36-794b70692b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be20ec3-6e19-46d3-bf36-794b70692b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e964fc15-f08e-446c-a7e0-d5100f9dbad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:16 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Volume 0c3de801-c18f-4197-adc7-54db83a145d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3de801-c18f-4197-adc7-54db83a145d8', 'volume_size': 1} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:16 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875" returned: 0 in 0.454s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:16 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 1G Jul 17 15:36:16 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:16 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 1G" returned: 0 in 0.410s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4652c249-52c2-437f-bab2-c131863bb875 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:16 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4652c249-52c2-437f-bab2-c131863bb875 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 Jul 17 15:36:16 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:17 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4652c249-52c2-437f-bab2-c131863bb875 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:17 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 is being set with open permissions: ugo+rw Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:17 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 Jul 17 15:36:17 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Flow 'volume_create_manager' (1874cdb4-dab9-4c33-a8d1-25a66fe0f7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3500f3-c768-419b-86ec-9a2aa960e617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3500f3-c768-419b-86ec-9a2aa960e617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1656588392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fb2bfc-9a21-4c4e-9338-e076777a7fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba845286dd044cfae5bc34654883db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:17Z,use_quota=True,user_id='99f6061b06f346959adc0d5556c85c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c191a034-70c8-496a-a95a-5e38b0dd7d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c191a034-70c8-496a-a95a-5e38b0dd7d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cc8e31-7bb1-4854-9e74-bab9699130a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cc8e31-7bb1-4854-9e74-bab9699130a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47fb2bfc-9a21-4c4e-9338-e076777a7fe0', 'volume_name': 'volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b1ac3d-baec-4698-b02b-a75f9cadf40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b1ac3d-baec-4698-b02b-a75f9cadf40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55397547-77b6-4ff0-a8d2-d3141d66e5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:17 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Volume 47fb2bfc-9a21-4c4e-9338-e076777a7fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0', 'volume_size': 1} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:17 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2" returned: 0 in 0.251s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:17 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.info Jul 17 15:36:17 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:17 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.info" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:17 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.info is being set with open permissions: ugo+rw Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:17 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.info Jul 17 15:36:17 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:17 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.info" returned: 0 in 0.246s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.704s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4df3c48a-3f93-453b-8b16-cb771fce66b7,created_at=2026-07-17T13:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1198104230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4df3c48a-3f93-453b-8b16-cb771fce66b7,host='devstack@QuobyteHD#QuobyteHD',id=0c3de801-c18f-4197-adc7-54db83a145d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d60141ed31d46bf8684933a53905673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:16Z,use_quota=True,user_id='9af66eec718444f7ad281422e32aec81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a5dfc4d-d689-4bab-8342-695f1679a695),volume_type_id=3a5dfc4d-d689-4bab-8342-695f1679a695)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Creating volume 0c3de801-c18f-4197-adc7-54db83a145d8 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:18 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:18 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8 1073741824 Jul 17 15:36:18 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:18 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-db052d76-6e3f-4242-8f47-15b22aad2f28 tempest-VolumeDependencyTests-1801168983 None] Create snapshot completed successfully Jul 17 15:36:18 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8 1073741824" returned: 0 in 0.436s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:18 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8 Jul 17 15:36:18 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:18 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8" returned: 0 in 0.269s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.407s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e964fc15-f08e-446c-a7e0-d5100f9dbad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3de801-c18f-4197-adc7-54db83a145d8', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5336721a-5eba-4e29-8f4b-0a7d0afda13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Creating offline snapshot f1125305-3797-44e0-9962-c3d2207cb48f of volume 84d72855-4d4c-4c94-bed8-092e6011d2ec {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:36:18 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Volume volume-0c3de801-c18f-4197-adc7-54db83a145d8 (0c3de801-c18f-4197-adc7-54db83a145d8): created successfully Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5336721a-5eba-4e29-8f4b-0a7d0afda13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Flow 'volume_create_manager' (5dd84ad9-df6e-4132-b1da-e097fc28664e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[29865fb2-4a74-40e1-84a7-904370860397]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:18 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c83f4ae3-bc54-4fd3-bd7a-37e1ec05201f tempest-GroupsTest-1586350207 None] Created volume successfully. Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Flow 'volume_create_manager' (a2b498c8-2d1b-4ab7-ad68-dbad444202eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa927dd-120f-497b-9c8c-8213298cb6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa927dd-120f-497b-9c8c-8213298cb6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1773325940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b38292-1515-41a2-a87f-0b6a209001f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9354abbaf3a24b809c265383be15552c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=677ff2e1-50b8-4550-bb91-8f1c9e19cfe2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:19Z,use_quota=True,user_id='488c1677d33c48cbb11c162497d3bee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3834ff-4996-4ccc-9b3f-562dd7e14613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3834ff-4996-4ccc-9b3f-562dd7e14613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f75ee54-7fb0-455c-8563-863225f8a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f75ee54-7fb0-455c-8563-863225f8a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58b38292-1515-41a2-a87f-0b6a209001f4', 'volume_name': 'volume-58b38292-1515-41a2-a87f-0b6a209001f4', 'volume_size': 1, 'snapshot_id': '677ff2e1-50b8-4550-bb91-8f1c9e19cfe2'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:18 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec Jul 17 15:36:18 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10783fea-1523-4535-98e8-f7efe5d53af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10783fea-1523-4535-98e8-f7efe5d53af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbdd12e9-47c6-4ac3-a25e-d03f4d4277da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:18 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Volume 58b38292-1515-41a2-a87f-0b6a209001f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58b38292-1515-41a2-a87f-0b6a209001f4', 'volume_size': 1, 'snapshot_id': '677ff2e1-50b8-4550-bb91-8f1c9e19cfe2'} Jul 17 15:36:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:19 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec" returned: 0 in 0.370s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:19 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f 1G Jul 17 15:36:19 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:19 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f 1G" returned: 0 in 0.397s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d72855-4d4c-4c94-bed8-092e6011d2ec -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:19 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d72855-4d4c-4c94-bed8-092e6011d2ec -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f Jul 17 15:36:19 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:19 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d72855-4d4c-4c94-bed8-092e6011d2ec -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f" returned: 0 in 0.363s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:19 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f is being set with open permissions: ugo+rw Jul 17 15:36:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:20 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f Jul 17 15:36:20 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:20 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f" returned: 0 in 0.269s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:20 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.info Jul 17 15:36:20 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Acquiring lock "cinder-quobyte-0c3de801-c18f-4197-adc7-54db83a145d8" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Lock "cinder-quobyte-0c3de801-c18f-4197-adc7-54db83a145d8" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faa1bf8-cd9e-485c-b514-3c54c7968775]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:20 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8 Jul 17 15:36:20 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:20 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.info" returned: 0 in 0.311s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:20 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.info is being set with open permissions: ugo+rw Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:20 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.info Jul 17 15:36:20 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:20 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8" returned: 0 in 0.367s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:20 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8 Jul 17 15:36:20 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:20 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.info" returned: 0 in 0.258s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.433s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1656588392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fb2bfc-9a21-4c4e-9338-e076777a7fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba845286dd044cfae5bc34654883db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:17Z,use_quota=True,user_id='99f6061b06f346959adc0d5556c85c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Creating volume 47fb2bfc-9a21-4c4e-9338-e076777a7fe0 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:20 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:20 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 1073741824 Jul 17 15:36:20 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:20 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5ff037c3-58ad-4eb2-af9e-228f3e34be17 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Create snapshot completed successfully Jul 17 15:36:21 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c3de801-c18f-4197-adc7-54db83a145d8" returned: 0 in 0.256s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Lock "cinder-quobyte-0c3de801-c18f-4197-adc7-54db83a145d8" released by "delete_volume" :: held 0.677s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Created reservations ['8da45b86-e1df-43b6-a8a9-b37f992621a7'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:21 devstack cinder-volume[87769]: WARNING cinder.quota [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1388806674 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1388806674, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:36:21 devstack cinder-volume[87769]: WARNING cinder.quota [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1388806674 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1388806674, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Created reservations ['6f12fece-d6e5-4ce1-8b2b-34933644fb40', 'cc3d5ff4-93e2-4936-9135-c0d1977ca70f', '7987c968-f2ab-4d3a-9860-005805c4dee1', '5e2010e1-66f3-47d3-9591-1740dfc573ad'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:21 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:21 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:21 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 1073741824" returned: 0 in 0.487s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:21 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 Jul 17 15:36:21 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:21 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.280s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c51f9633-1028-498d-a7df-a9a69f58c6d7 tempest-GroupsTest-1586350207 None] Delete group completed successfully. Jul 17 15:36:21 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0" returned: 0 in 0.275s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.738s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "cinder-quobyte-677ff2e1-50b8-4550-bb91-8f1c9e19cfe2-58b38292-1515-41a2-a87f-0b6a209001f4" by "_create_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55397547-77b6-4ff0-a8d2-d3141d66e5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a16a344-7714-48f6-a024-57ca195230e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-677ff2e1-50b8-4550-bb91-8f1c9e19cfe2-58b38292-1515-41a2-a87f-0b6a209001f4" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Creating volume 58b38292-1515-41a2-a87f-0b6a209001f4 from snapshot 677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 {{(pid=87769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "cinder-quobyte-58b38292-1515-41a2-a87f-0b6a209001f4" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] Created reservations ['0678c07b-af13-4831-aa49-794c4f548cf1'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Volume volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 (47fb2bfc-9a21-4c4e-9338-e076777a7fe0): created successfully Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a16a344-7714-48f6-a024-57ca195230e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Flow 'volume_create_manager' (1874cdb4-dab9-4c33-a8d1-25a66fe0f7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-58b38292-1515-41a2-a87f-0b6a209001f4" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] snapshot: 677ff2e1-50b8-4550-bb91-8f1c9e19cfe2, volume: 58b38292-1515-41a2-a87f-0b6a209001f4, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:36:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-38882106-ed01-4efb-b930-1b7a3ab1a77f tempest-VolumesNegativeTest-406935977 None] Created volume successfully. Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d96a72-5e80-4ea1-b982-88297fa2d9ef]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Acquiring lock "cinder-f1125305-3797-44e0-9962-c3d2207cb48f-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-f1125305-3797-44e0-9962-c3d2207cb48f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Acquiring lock "cinder-quobyte-84d72855-4d4c-4c94-bed8-092e6011d2ec" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:22 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:22 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-quobyte-84d72855-4d4c-4c94-bed8-092e6011d2ec" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Acquiring lock "cinder-quobyte-f1125305-3797-44e0-9962-c3d2207cb48f" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-quobyte-f1125305-3797-44e0-9962-c3d2207cb48f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Deleting offline snapshot f1125305-3797-44e0-9962-c3d2207cb48f of volume 84d72855-4d4c-4c94-bed8-092e6011d2ec {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:36:22 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 Jul 17 15:36:22 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] snapshot_file for this snap is: volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94d29a-92d8-4d39-b876-7105b78d7ef6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:22 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f Jul 17 15:36:22 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:22 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.256s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d17330a2-8a52-4938-906d-39e1af873263 tempest-GroupsTest-1586350207 None] Delete group completed successfully. Jul 17 15:36:22 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2" returned: 0 in 0.396s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4652c249-52c2-437f-bab2-c131863bb875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a43a962-de55-457a-ae8b-973113b32311]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:22 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 Jul 17 15:36:22 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:22 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f" returned: 0 in 0.385s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84d72855-4d4c-4c94-bed8-092e6011d2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[931e81a3-9c7e-487c-ba04-cb79c487e1c1]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:22 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec Jul 17 15:36:22 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:22 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875" returned: 0 in 0.422s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:36:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:22 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:22 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:22 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 Jul 17 15:36:22 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:23 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec" returned: 0 in 0.575s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:23 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f Jul 17 15:36:23 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:23 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.508s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:36:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:36:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:36:23 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f" returned: 0 in 0.677s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:23 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f Jul 17 15:36:23 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7e1fc2b6-fcff-47e4-a3de-78c6339467bf tempest-GroupsTest-1586350207 None] Group tempest-GroupsTest-Group-947927023: creating Jul 17 15:36:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7e1fc2b6-fcff-47e4-a3de-78c6339467bf tempest-GroupsTest-1586350207 None] Group tempest-GroupsTest-Group-947927023: created successfully Jul 17 15:36:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7e1fc2b6-fcff-47e4-a3de-78c6339467bf tempest-GroupsTest-1586350207 None] Create group completed successfully. Jul 17 15:36:24 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec.f1125305-3797-44e0-9962-c3d2207cb48f" returned: 0 in 0.682s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-quobyte-f1125305-3797-44e0-9962-c3d2207cb48f" released by "_delete_snapshot" :: held 2.514s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-quobyte-84d72855-4d4c-4c94-bed8-092e6011d2ec" released by "delete_snapshot" :: held 2.553s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:24 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Created reservations ['04b59aaf-1668-4006-9689-fe393fafbbfe', '38440c4b-928b-47d0-b46b-8b4f6d26667f', '7afdb9b7-842c-46c9-aca2-273ece8658f2', 'dc650018-3ff0-4c33-add4-57347e509027'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Delete snapshot completed successfully. Jul 17 15:36:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-35118d84-6638-4f8d-ab10-a4b6026848b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-f1125305-3797-44e0-9962-c3d2207cb48f-delete_snapshot" released by "delete_snapshot" :: held 3.003s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Acquiring lock "cinder-84d72855-4d4c-4c94-bed8-092e6011d2ec-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-84d72855-4d4c-4c94-bed8-092e6011d2ec-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Acquiring lock "cinder-quobyte-84d72855-4d4c-4c94-bed8-092e6011d2ec" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-quobyte-84d72855-4d4c-4c94-bed8-092e6011d2ec" acquired by "delete_volume" :: waited 0.044s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c315b-0f1a-46fe-b065-2a8e3d94c3d8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:26 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec Jul 17 15:36:26 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Flow 'volume_create_manager' (f6f2cee9-764a-465e-bf5c-519d1ec47489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf806b6-31d9-4beb-9ee3-70f008dab51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf806b6-31d9-4beb-9ee3-70f008dab51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1263198072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b422412d-07a5-4f02-8fe5-acbbf0afec74,host='devstack@QuobyteHD#QuobyteHD',id=f1b92f3c-a630-4cd6-ba0a-c3d3684075de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d60141ed31d46bf8684933a53905673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:26Z,use_quota=True,user_id='9af66eec718444f7ad281422e32aec81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83a38edc-3912-4b6b-850d-916c234d131c),volume_type_id=83a38edc-3912-4b6b-850d-916c234d131c)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f817978-8c67-438a-a1bf-b3de7741581c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f817978-8c67-438a-a1bf-b3de7741581c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc6a5e3-6e1f-47c1-9c94-f9665a56fa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc6a5e3-6e1f-47c1-9c94-f9665a56fa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b92f3c-a630-4cd6-ba0a-c3d3684075de', 'volume_name': 'volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71141a37-1a2d-47a9-9045-0e4087f4648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71141a37-1a2d-47a9-9045-0e4087f4648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daec684-c6cc-4244-b600-39bff6fe730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:26 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Volume f1b92f3c-a630-4cd6-ba0a-c3d3684075de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de', 'volume_size': 1} Jul 17 15:36:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:27 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec" returned: 0 in 1.026s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:27 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec Jul 17 15:36:27 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:28 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84d72855-4d4c-4c94-bed8-092e6011d2ec" returned: 0 in 1.096s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-quobyte-84d72855-4d4c-4c94-bed8-092e6011d2ec" released by "delete_volume" :: held 2.395s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:28 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Created reservations ['f7caf9bb-adff-4b83-a08d-e125334038a5', '251b639b-59d5-4bb7-85c6-bf13d24b95a4', 'fd3baaf4-d1b8-49dd-92b4-ceb125d7d7df', '8e7e9601-46ce-489f-bf8b-4eb357c8b6be'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:28 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:28 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:29 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4" returned: 0 in 6.391s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:29 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4951ae02-8533-433f-bcc4-44943257f928]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:29 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.493s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:29 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:29 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Deleted volume successfully. Jul 17 15:36:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10ad1992-71cf-4ac4-8d02-8c43aef00d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2005071507 None] Lock "cinder-84d72855-4d4c-4c94-bed8-092e6011d2ec-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:29 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 Jul 17 15:36:29 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:29 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875" returned: 0 in 0.681s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:29 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:36:29 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Converted 1024.00 MB image at 160.20 MB/s Jul 17 15:36:29 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 is being set with open permissions: ugo+rw Jul 17 15:36:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:29 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 Jul 17 15:36:29 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:30 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4" returned: 0 in 0.293s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-58b38292-1515-41a2-a87f-0b6a209001f4" released by "_copy_volume_from_snapshot" :: held 8.328s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-677ff2e1-50b8-4550-bb91-8f1c9e19cfe2-58b38292-1515-41a2-a87f-0b6a209001f4" released by "_create_volume_from_snapshot" :: held 8.390s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.443s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.439s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b422412d-07a5-4f02-8fe5-acbbf0afec74,created_at=2026-07-17T13:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1263198072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b422412d-07a5-4f02-8fe5-acbbf0afec74,host='devstack@QuobyteHD#QuobyteHD',id=f1b92f3c-a630-4cd6-ba0a-c3d3684075de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d60141ed31d46bf8684933a53905673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:26Z,use_quota=True,user_id='9af66eec718444f7ad281422e32aec81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83a38edc-3912-4b6b-850d-916c234d131c),volume_type_id=83a38edc-3912-4b6b-850d-916c234d131c)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Creating volume f1b92f3c-a630-4cd6-ba0a-c3d3684075de {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:30 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:30 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de 1073741824 Jul 17 15:36:30 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbdd12e9-47c6-4ac3-a25e-d03f4d4277da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b38292-1515-41a2-a87f-0b6a209001f4', 'volume_size': 1, 'snapshot_id': '677ff2e1-50b8-4550-bb91-8f1c9e19cfe2'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a114b40a-d51b-4b5d-b95a-40fc86cd8432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:30 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Volume volume-58b38292-1515-41a2-a87f-0b6a209001f4 (58b38292-1515-41a2-a87f-0b6a209001f4): created successfully Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a114b40a-d51b-4b5d-b95a-40fc86cd8432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Flow 'volume_create_manager' (a2b498c8-2d1b-4ab7-ad68-dbad444202eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:30 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4881cbd0-cb42-4174-a21c-07f143da65c0 tempest-VolumeDependencyTests-1801168983 None] Created volume successfully. Jul 17 15:36:30 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de 1073741824" returned: 0 in 0.529s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:30 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de Jul 17 15:36:30 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:31 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de" returned: 0 in 0.296s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daec684-c6cc-4244-b600-39bff6fe730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe17b7d-0c31-4ede-b99d-ee56a8a36e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:31 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Volume volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de (f1b92f3c-a630-4cd6-ba0a-c3d3684075de): created successfully Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe17b7d-0c31-4ede-b99d-ee56a8a36e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Flow 'volume_create_manager' (f6f2cee9-764a-465e-bf5c-519d1ec47489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:31 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9ab81c9c-029e-45d1-b280-5d5d60b9b32d tempest-GroupsTest-1586350207 None] Created volume successfully. Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "cinder-677ff2e1-50b8-4550-bb91-8f1c9e19cfe2-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-677ff2e1-50b8-4550-bb91-8f1c9e19cfe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "cinder-quobyte-4652c249-52c2-437f-bab2-c131863bb875" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-4652c249-52c2-437f-bab2-c131863bb875" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "cinder-quobyte-677ff2e1-50b8-4550-bb91-8f1c9e19cfe2" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-677ff2e1-50b8-4550-bb91-8f1c9e19cfe2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Deleting offline snapshot 677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 of volume 4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] snapshot_file for this snap is: volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6745e7db-86b1-4fc3-8b7c-da4b6033d719]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:31 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 Jul 17 15:36:31 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:32 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2" returned: 0 in 0.749s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4652c249-52c2-437f-bab2-c131863bb875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:36:32 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68546b8-49bc-40fa-9341-f4316dd663b4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:32 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 Jul 17 15:36:32 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:33 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875" returned: 0 in 0.805s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:33 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 Jul 17 15:36:33 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Flow 'volume_create_manager' (d51716f7-624c-4803-b858-710aa79526ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf498ed5-ca58-4a02-bca4-6dc962d9ddba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf498ed5-ca58-4a02-bca4-6dc962d9ddba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615634165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b422412d-07a5-4f02-8fe5-acbbf0afec74,host='devstack@QuobyteHD#QuobyteHD',id=71155b28-6c98-499a-b37a-ab1ad8e59a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d60141ed31d46bf8684933a53905673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:33Z,use_quota=True,user_id='9af66eec718444f7ad281422e32aec81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83a38edc-3912-4b6b-850d-916c234d131c),volume_type_id=83a38edc-3912-4b6b-850d-916c234d131c)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb6137f-c7e3-4e84-85ca-dc536955373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb6137f-c7e3-4e84-85ca-dc536955373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3958e30b-764d-40b7-b511-9b69781b820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3958e30b-764d-40b7-b511-9b69781b820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71155b28-6c98-499a-b37a-ab1ad8e59a60', 'volume_name': 'volume-71155b28-6c98-499a-b37a-ab1ad8e59a60', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef160f36-0cc1-4a14-84ae-654c8b98677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef160f36-0cc1-4a14-84ae-654c8b98677c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8367da92-c70b-4ef7-bc5f-b27987e22f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:33 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Volume 71155b28-6c98-499a-b37a-ab1ad8e59a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71155b28-6c98-499a-b37a-ab1ad8e59a60', 'volume_size': 1} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b422412d-07a5-4f02-8fe5-acbbf0afec74,created_at=2026-07-17T13:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615634165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b422412d-07a5-4f02-8fe5-acbbf0afec74,host='devstack@QuobyteHD#QuobyteHD',id=71155b28-6c98-499a-b37a-ab1ad8e59a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d60141ed31d46bf8684933a53905673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:33Z,use_quota=True,user_id='9af66eec718444f7ad281422e32aec81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83a38edc-3912-4b6b-850d-916c234d131c),volume_type_id=83a38edc-3912-4b6b-850d-916c234d131c)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Creating volume 71155b28-6c98-499a-b37a-ab1ad8e59a60 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:33 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:33 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 1073741824 Jul 17 15:36:33 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:34 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2" returned: 0 in 0.683s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:34 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2 Jul 17 15:36:34 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:34 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875.677ff2e1-50b8-4550-bb91-8f1c9e19cfe2" returned: 0 in 0.355s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:34 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 1073741824" returned: 0 in 0.663s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-677ff2e1-50b8-4550-bb91-8f1c9e19cfe2" released by "_delete_snapshot" :: held 2.846s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-4652c249-52c2-437f-bab2-c131863bb875" released by "delete_snapshot" :: held 2.890s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:34 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 Jul 17 15:36:34 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Created reservations ['43949c47-d207-430d-824b-d0909eed830f', 'c1f37ed0-e082-44bf-b53a-60a07f3911ff', '3074ea2a-419e-4616-82bf-cdfa209fc084', '2aa1d753-4190-48a7-b150-1552bf080761'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:34 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Delete snapshot completed successfully. Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-27cb0485-3d01-44d2-8df4-72dea904b9ef tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-677ff2e1-50b8-4550-bb91-8f1c9e19cfe2-delete_snapshot" released by "delete_snapshot" :: held 3.133s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:34 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60" returned: 0 in 0.380s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8367da92-c70b-4ef7-bc5f-b27987e22f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71155b28-6c98-499a-b37a-ab1ad8e59a60', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e589318f-4ade-4bc1-a31d-f74aef4c354e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "cinder-4652c249-52c2-437f-bab2-c131863bb875-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:34 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Volume volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 (71155b28-6c98-499a-b37a-ab1ad8e59a60): created successfully Jul 17 15:36:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e589318f-4ade-4bc1-a31d-f74aef4c354e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Flow 'volume_create_manager' (d51716f7-624c-4803-b858-710aa79526ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-4652c249-52c2-437f-bab2-c131863bb875-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:35 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7d426b72-5cb9-45f5-b4b4-03ff09e6b0fe tempest-GroupsTest-1586350207 None] Created volume successfully. Jul 17 15:36:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "cinder-quobyte-4652c249-52c2-437f-bab2-c131863bb875" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-4652c249-52c2-437f-bab2-c131863bb875" acquired by "delete_volume" :: waited 0.054s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:35 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7d5b8f-0fbc-482f-b54a-5635bdbec284]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:35 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 Jul 17 15:36:35 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:35 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875" returned: 0 in 0.527s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:35 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875 Jul 17 15:36:35 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:36 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4652c249-52c2-437f-bab2-c131863bb875" returned: 0 in 0.400s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-4652c249-52c2-437f-bab2-c131863bb875" released by "delete_volume" :: held 1.022s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Created reservations ['119631bb-ecdb-4ce8-ab80-85749d64a971', '25f3ebfc-d541-420c-a761-6f2d95ff87d4', '704d3753-67e4-42d3-9900-6f7d34d94373', '6fffce9d-5a42-47b0-8a68-f49a57b83e7b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:36 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:36 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:36 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-937f892a-9a4e-435f-89f0-3e850d3e41a6 tempest-GroupsTest-1586350207 None] Update group completed successfully. Jul 17 15:36:36 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.395s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:36 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Deleted volume successfully. Jul 17 15:36:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1fe81df0-3faf-4b9f-8562-418d986e7e6c tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-4652c249-52c2-437f-bab2-c131863bb875-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "cinder-58b38292-1515-41a2-a87f-0b6a209001f4-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-58b38292-1515-41a2-a87f-0b6a209001f4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "cinder-quobyte-58b38292-1515-41a2-a87f-0b6a209001f4" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-58b38292-1515-41a2-a87f-0b6a209001f4" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:37 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8094eacd-2c29-41cd-bd19-67d0a936f2d9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:37 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 Jul 17 15:36:37 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:37 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4" returned: 0 in 0.446s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:37 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4 Jul 17 15:36:37 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:38 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8ba18a9b-da0c-4e14-999d-d0eb461958b3 tempest-GroupsTest-1586350207 None] Update group completed successfully. Jul 17 15:36:38 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-58b38292-1515-41a2-a87f-0b6a209001f4" returned: 0 in 0.312s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-quobyte-58b38292-1515-41a2-a87f-0b6a209001f4" released by "delete_volume" :: held 0.817s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Created reservations ['9039bfe2-24cd-48c7-81f4-0cc72020d39f', 'd295aead-1633-4015-b9cf-4ebe4b4eb558', '6392ee04-7371-434e-b345-411461b28edf', '570d27ee-4372-43da-b5a8-5ef4ad49b3c5'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:38 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:38 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:38 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.326s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:38 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Deleted volume successfully. Jul 17 15:36:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea064826-262d-43ea-b34c-ef16583804e8 tempest-VolumeDependencyTests-1801168983 None] Lock "cinder-58b38292-1515-41a2-a87f-0b6a209001f4-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Acquiring lock "cinder-quobyte-71155b28-6c98-499a-b37a-ab1ad8e59a60" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Lock "cinder-quobyte-71155b28-6c98-499a-b37a-ab1ad8e59a60" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:39 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eca074-19be-4426-880d-821a9e4d688f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:40 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 Jul 17 15:36:40 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:40 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60" returned: 0 in 0.544s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:40 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60 Jul 17 15:36:40 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:40 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-71155b28-6c98-499a-b37a-ab1ad8e59a60" returned: 0 in 0.295s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Lock "cinder-quobyte-71155b28-6c98-499a-b37a-ab1ad8e59a60" released by "delete_volume" :: held 0.906s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Acquiring lock "cinder-quobyte-f1b92f3c-a630-4cd6-ba0a-c3d3684075de" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Lock "cinder-quobyte-f1b92f3c-a630-4cd6-ba0a-c3d3684075de" acquired by "delete_volume" :: waited 0.039s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:40 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4377f72a-84c3-40a1-97a5-8bda39a7a44b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:41 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de Jul 17 15:36:41 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:41 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de" returned: 0 in 0.503s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:41 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de Jul 17 15:36:41 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:41 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f1b92f3c-a630-4cd6-ba0a-c3d3684075de" returned: 0 in 0.392s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Lock "cinder-quobyte-f1b92f3c-a630-4cd6-ba0a-c3d3684075de" released by "delete_volume" :: held 0.978s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:41 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Created reservations ['052bad33-1d69-4e46-9a18-bafb2e3c8d3d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:41 devstack cinder-volume[87769]: WARNING cinder.quota [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-113131799 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-113131799, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:36:41 devstack cinder-volume[87769]: WARNING cinder.quota [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-113131799 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-113131799, it is now deprecated. Please use the default quota class for default quota. Jul 17 15:36:41 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Created reservations ['27664108-11cf-4d13-bb0c-68e2419869dc', '4535371e-cc42-48c9-885b-c053518f093a', 'c3ea7bce-f052-4588-9a94-15946e9ea5cc', '6e5a3f36-d561-42d5-af9a-7c3b63aec8b6'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:42 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Created reservations ['e83d282c-c7b8-4fe0-98b6-0aa1691412e4', '4114120a-24f0-43ee-83f7-e23e65b17532', '77889976-5083-4e32-a56c-414e7f251efe', 'dd4ea3e9-2a25-41e4-a4b8-051b1c5811fe'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:42 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:42 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:42 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.309s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:42 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c563cffd-b1c2-4440-873f-f6ec6782723f tempest-GroupsTest-1586350207 None] Delete group completed successfully. Jul 17 15:36:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Acquiring lock "cinder-47fb2bfc-9a21-4c4e-9338-e076777a7fe0-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Lock "cinder-47fb2bfc-9a21-4c4e-9338-e076777a7fe0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:47 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=215,cinder:SELECT=169,cinder:INSERT=51,cinder:DELETE=13 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:36:47 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=182,cinder:DELETE=12,cinder:INSERT=54,cinder:UPDATE=198 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:36:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Acquiring lock "cinder-quobyte-47fb2bfc-9a21-4c4e-9338-e076777a7fe0" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Lock "cinder-quobyte-47fb2bfc-9a21-4c4e-9338-e076777a7fe0" acquired by "delete_volume" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:47 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e215463-67b4-4f0d-9d2f-fdda06712633]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:47 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 Jul 17 15:36:47 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:48 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0" returned: 0 in 0.515s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:48 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0 Jul 17 15:36:48 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:48 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-47fb2bfc-9a21-4c4e-9338-e076777a7fe0" returned: 0 in 0.343s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Lock "cinder-quobyte-47fb2bfc-9a21-4c4e-9338-e076777a7fe0" released by "delete_volume" :: held 0.938s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Flow 'volume_create_manager' (3b1338b2-69b7-4fd8-94cf-477704fcb91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea416dc-721e-4a41-8380-4b53b38d2026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea416dc-721e-4a41-8380-4b53b38d2026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1188784616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cea113-9cb1-4203-bd4b-ec205a8325ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe601fa4b86644a6870b5a4172d89ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:49Z,use_quota=True,user_id='a846979980cb4a999ebc59cc686d4b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84c1179-b10c-43e8-ae8b-e3069be12a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84c1179-b10c-43e8-ae8b-e3069be12a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67355297-0505-4795-809e-b48c2b7ddf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.image.glance [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Creating Keystone auth plugin from conf {{(pid=87769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Created reservations ['3b315abb-cc5f-45ff-a0b4-7e3bcea7ccf8', 'db77660e-e3b5-4f86-810c-d8ffeb303605', '47bcb60d-8f9a-4acc-83ac-1781b26b3ee4', 'ae9a7aae-4304-4aa0-888a-69ab95a45427'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:48 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:48 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:49 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:49 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Deleted volume successfully. Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ae1d33c-378b-4759-bd52-71dc17979e5a tempest-VolumesNegativeTest-406935977 None] Lock "cinder-47fb2bfc-9a21-4c4e-9338-e076777a7fe0-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67355297-0505-4795-809e-b48c2b7ddf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56cea113-9cb1-4203-bd4b-ec205a8325ec', 'volume_name': 'volume-56cea113-9cb1-4203-bd4b-ec205a8325ec', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e5218d-4ab6-43a4-b36c-c5889e35983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e5218d-4ab6-43a4-b36c-c5889e35983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adc8606-8eb4-4afd-aa75-75fc15bcd1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:49 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Volume 56cea113-9cb1-4203-bd4b-ec205a8325ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56cea113-9cb1-4203-bd4b-ec205a8325ec', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Trying to clone 56cea113-9cb1-4203-bd4b-ec205a8325ec from image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]). {{(pid=87769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 15:36:49 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Image download 20.69 MB at 20.69 MB/s Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[301a63ac-6da0-42b7-8d28-56e1e67b8f43]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:49 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD Jul 17 15:36:49 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Flow 'volume_create_manager' (6a046dc8-862a-48dc-82b0-30c749dcc604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a4d69a-79cf-4852-abf7-6737c9d632a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a4d69a-79cf-4852-abf7-6737c9d632a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1383530484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f62384-4261-495e-a61b-ffe5444c4538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50dc9ff558a8443da1c16f48f1e4137b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:50Z,use_quota=True,user_id='fdaba8fa83694326ae61161af9be9fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:50 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd42b44-93a3-4faa-8645-ebf781dfa851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd42b44-93a3-4faa-8645-ebf781dfa851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344d5f4-5db4-4e18-8987-d69a6025dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344d5f4-5db4-4e18-8987-d69a6025dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f62384-4261-495e-a61b-ffe5444c4538', 'volume_name': 'volume-50f62384-4261-495e-a61b-ffe5444c4538', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ff7545-78f4-47d8-9b9d-63e032fe8ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ff7545-78f4-47d8-9b9d-63e032fe8ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c757f69a-6979-458b-a198-386fa877d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Volume 50f62384-4261-495e-a61b-ffe5444c4538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f62384-4261-495e-a61b-ffe5444c4538', 'volume_size': 1} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1383530484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f62384-4261-495e-a61b-ffe5444c4538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50dc9ff558a8443da1c16f48f1e4137b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:50Z,use_quota=True,user_id='fdaba8fa83694326ae61161af9be9fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Creating volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:50 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Temporary image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 is fetched for user a846979980cb4a999ebc59cc686d4b54. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 15:36:50 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 1073741824 Jul 17 15:36:50 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe82bf6-7397-4287-ad1a-3e3153b96ebd]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:50 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD Jul 17 15:36:50 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:50 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:50 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 1073741824" returned: 0 in 0.585s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:50 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 Jul 17 15:36:50 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:51 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538" returned: 0 in 0.302s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1188784616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cea113-9cb1-4203-bd4b-ec205a8325ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe601fa4b86644a6870b5a4172d89ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:49Z,use_quota=True,user_id='a846979980cb4a999ebc59cc686d4b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Creating volume 56cea113-9cb1-4203-bd4b-ec205a8325ec {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:51 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:51 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec 1073741824 Jul 17 15:36:51 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c757f69a-6979-458b-a198-386fa877d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f62384-4261-495e-a61b-ffe5444c4538', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8c2cbd-b121-4b90-a03d-f5e4861856df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Volume volume-50f62384-4261-495e-a61b-ffe5444c4538 (50f62384-4261-495e-a61b-ffe5444c4538): created successfully Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8c2cbd-b121-4b90-a03d-f5e4861856df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Flow 'volume_create_manager' (6a046dc8-862a-48dc-82b0-30c749dcc604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Flow 'volume_create_manager' (d0d5cfc7-0cff-4974-b73a-69d61a0809b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7846651-f012-4802-8dc9-b170105cf35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7846651-f012-4802-8dc9-b170105cf35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83713341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f261fbd-e298-4406-88f6-08b6afe8a3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804d2d9ce82437a86cabca8b2f7c7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:51Z,use_quota=True,user_id='8e08b620b3744e34a6547c927dd540da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8e485c-7d4a-463e-8fe3-b741de18eb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8e485c-7d4a-463e-8fe3-b741de18eb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc72797d-752d-471f-adcd-3a766227e26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc72797d-752d-471f-adcd-3a766227e26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f261fbd-e298-4406-88f6-08b6afe8a3c4', 'volume_name': 'volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1a301a-fbb3-4824-a732-b519c73a32e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1a301a-fbb3-4824-a732-b519c73a32e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babe517f-13fc-4e98-91b4-36440d713872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Volume 6f261fbd-e298-4406-88f6-08b6afe8a3c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4', 'volume_size': 1} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:51 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4a950dd9-a343-4085-b041-334c71c7bc6a tempest-SnapshotsActionsTest-748878355 None] Created volume successfully. Jul 17 15:36:51 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec 1073741824" returned: 0 in 0.458s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:51 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec Jul 17 15:36:51 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:51 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec" returned: 0 in 0.266s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83713341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f261fbd-e298-4406-88f6-08b6afe8a3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804d2d9ce82437a86cabca8b2f7c7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:51Z,use_quota=True,user_id='8e08b620b3744e34a6547c927dd540da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Creating volume 6f261fbd-e298-4406-88f6-08b6afe8a3c4 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:51 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:52 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 1073741824 Jul 17 15:36:52 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Attempting download of 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 ((None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}])) to volume 56cea113-9cb1-4203-bd4b-ec205a8325ec. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b350ed6d-f02b-4b7f-894c-ff4c5834513f]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fddct042 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:52 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fddct042 Jul 17 15:36:52 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:52 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 1073741824" returned: 0 in 0.536s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:52 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fddct042" returned: 0 in 0.471s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fddct042 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:52 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 Jul 17 15:36:52 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:52 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fddct042 Jul 17 15:36:52 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:52 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4" returned: 0 in 0.304s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.410s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Creating offline snapshot f76093e4-3196-4c3c-820e-78d73f00e2b2 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babe517f-13fc-4e98-91b4-36440d713872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5eb8593-ae78-4fc5-b668-6c749cd336ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c00ed92-58f0-4dae-b546-f8bb46c6cc72]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:52 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:52 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Volume volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 (6f261fbd-e298-4406-88f6-08b6afe8a3c4): created successfully Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5eb8593-ae78-4fc5-b668-6c749cd336ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Flow 'volume_create_manager' (d0d5cfc7-0cff-4974-b73a-69d61a0809b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fddct042" returned: 1 in 0.413s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_fddct042' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad34aceb-a50d-4054-829b-9904d016ec2f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-331891d1-00e7-46e0-8d94-a48e0d05722a tempest-ProjectReaderTests-1859064017 None] Created volume successfully. Jul 17 15:36:53 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 Jul 17 15:36:53 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:53 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD Jul 17 15:36:53 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:53 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538" returned: 0 in 0.426s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:53 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 was qcow2, converting to qcow2 {{(pid=87769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:53 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 1G Jul 17 15:36:53 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:53 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec Jul 17 15:36:53 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "cinder-6f261fbd-e298-4406-88f6-08b6afe8a3c4-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-6f261fbd-e298-4406-88f6-08b6afe8a3c4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "cinder-quobyte-6f261fbd-e298-4406-88f6-08b6afe8a3c4" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-quobyte-6f261fbd-e298-4406-88f6-08b6afe8a3c4" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c81279f-e16d-4c26-b636-c932b5e7e638]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:53 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 1G" returned: 0 in 0.633s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:54 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:36:54 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:54 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 Jul 17 15:36:54 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:54 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4" returned: 0 in 0.410s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:54 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.359s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:54 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 is being set with open permissions: ugo+rw Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:54 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4 Jul 17 15:36:54 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:54 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:36:54 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:54 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6f261fbd-e298-4406-88f6-08b6afe8a3c4" returned: 0 in 0.309s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-quobyte-6f261fbd-e298-4406-88f6-08b6afe8a3c4" released by "delete_volume" :: held 0.778s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:54 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.330s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Created reservations ['e0ed3d2d-65cd-48ed-a1b8-af0fd13fb68a', 'e5e7161f-2102-4560-99ca-f5804d3e4286', 'e517f435-76c6-47ed-ab14-90c9ba89928a', '340e06fb-4054-49e5-8219-682fa0477039'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:54 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.info Jul 17 15:36:54 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:54 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:54 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:55 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.info" returned: 0 in 0.401s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:55 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.info is being set with open permissions: ugo+rw Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:55 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.info Jul 17 15:36:55 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:55 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.529s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Deleted volume successfully. Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b7a0c1c1-21fb-4a7b-843e-59fe6c92ab78 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-6f261fbd-e298-4406-88f6-08b6afe8a3c4-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:55 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.info" returned: 0 in 0.472s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a20a3cd8-9517-4191-95ce-4dc41cbc86f0 tempest-SnapshotsActionsTest-748878355 None] Create snapshot completed successfully Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Flow 'volume_create_manager' (45d05520-6206-4e52-8b0a-e0db544d3e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ea1ba2-a58a-45da-8b32-67a820e9c3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ea1ba2-a58a-45da-8b32-67a820e9c3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511388457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af201928-bd5e-445f-8799-7b8f2a757448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804d2d9ce82437a86cabca8b2f7c7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:56Z,use_quota=True,user_id='8e08b620b3744e34a6547c927dd540da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f15e4e-17fe-42a0-a5c8-cb2d26ea9daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f15e4e-17fe-42a0-a5c8-cb2d26ea9daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1be18b-5381-4a89-8312-d35d63705e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1be18b-5381-4a89-8312-d35d63705e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af201928-bd5e-445f-8799-7b8f2a757448', 'volume_name': 'volume-af201928-bd5e-445f-8799-7b8f2a757448', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (becf14b1-429b-4ca3-a361-9f7559debda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (becf14b1-429b-4ca3-a361-9f7559debda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe3def4-185a-4822-8a01-9b6f07486720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:55 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Volume af201928-bd5e-445f-8799-7b8f2a757448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af201928-bd5e-445f-8799-7b8f2a757448', 'volume_size': 1} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511388457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af201928-bd5e-445f-8799-7b8f2a757448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804d2d9ce82437a86cabca8b2f7c7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:36:56Z,use_quota=True,user_id='8e08b620b3744e34a6547c927dd540da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Creating volume af201928-bd5e-445f-8799-7b8f2a757448 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:55 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:36:55 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec" returned: 0 in 2.468s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_y_uv86umdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:36:55 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Converted 112.00 MB image at 45.34 MB/s Jul 17 15:36:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:55 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448 1073741824 Jul 17 15:36:55 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:55 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec 1G Jul 17 15:36:55 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:56 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec 1G" returned: 0 in 0.377s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Downloaded image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 ((None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}])) to volume 56cea113-9cb1-4203-bd4b-ec205a8325ec successfully. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Temporary image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 for user a846979980cb4a999ebc59cc686d4b54 is deleted. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Marking volume 56cea113-9cb1-4203-bd4b-ec205a8325ec as bootable. {{(pid=87769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Copying metadata from image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 to 56cea113-9cb1-4203-bd4b-ec205a8325ec. {{(pid=87769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Creating volume glance metadata for volume 56cea113-9cb1-4203-bd4b-ec205a8325ec backed by image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 15:36:56 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448 1073741824" returned: 0 in 0.505s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adc8606-8eb4-4afd-aa75-75fc15bcd1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56cea113-9cb1-4203-bd4b-ec205a8325ec', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb28d3a-c704-4977-8d50-5ecb60944ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:56 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Volume volume-56cea113-9cb1-4203-bd4b-ec205a8325ec (56cea113-9cb1-4203-bd4b-ec205a8325ec): created successfully Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb28d3a-c704-4977-8d50-5ecb60944ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Flow 'volume_create_manager' (3b1338b2-69b7-4fd8-94cf-477704fcb91f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5f0c3a1b-2054-4449-b9d5-c90c2877e24b tempest-VolumesImageMetadata-1432220602 None] Created volume successfully. Jul 17 15:36:56 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448 Jul 17 15:36:56 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:56 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448" returned: 0 in 0.296s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe3def4-185a-4822-8a01-9b6f07486720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af201928-bd5e-445f-8799-7b8f2a757448', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720ddfe2-4895-4c1a-bb0d-61f475025feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:36:56 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Volume volume-af201928-bd5e-445f-8799-7b8f2a757448 (af201928-bd5e-445f-8799-7b8f2a757448): created successfully Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720ddfe2-4895-4c1a-bb0d-61f475025feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:36:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Flow 'volume_create_manager' (45d05520-6206-4e52-8b0a-e0db544d3e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:36:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-959a7af8-fb6f-4ab0-b13e-3132c24a483a tempest-ProjectReaderTests-1859064017 None] Created volume successfully. Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Creating offline snapshot f3d08e8b-a497-42a7-8d09-ca7dd03d9645 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc377b6-86c7-488a-b3c5-5bbc5c70c23a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:57 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:36:57 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Acquiring lock "cinder-56cea113-9cb1-4203-bd4b-ec205a8325ec-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Lock "cinder-56cea113-9cb1-4203-bd4b-ec205a8325ec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Acquiring lock "cinder-quobyte-56cea113-9cb1-4203-bd4b-ec205a8325ec" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Lock "cinder-quobyte-56cea113-9cb1-4203-bd4b-ec205a8325ec" acquired by "delete_volume" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cda5752-8da7-4548-b089-37eccc5933af]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:57 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Acquiring lock "cinder-af201928-bd5e-445f-8799-7b8f2a757448-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.612s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:57 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:36:57 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Lock "cinder-af201928-bd5e-445f-8799-7b8f2a757448-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:57 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 1G Jul 17 15:36:57 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Acquiring lock "cinder-quobyte-af201928-bd5e-445f-8799-7b8f2a757448" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Lock "cinder-quobyte-af201928-bd5e-445f-8799-7b8f2a757448" acquired by "delete_volume" :: waited 0.049s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[806e8ab6-a513-455a-98c6-e3bb7201c841]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:58 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec" returned: 0 in 0.558s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:58 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448 Jul 17 15:36:58 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:58 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec Jul 17 15:36:58 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:58 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 1G" returned: 0 in 0.619s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:58 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 Jul 17 15:36:58 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:58 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448" returned: 0 in 0.483s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:58 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-56cea113-9cb1-4203-bd4b-ec205a8325ec" returned: 0 in 0.349s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:58 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448 Jul 17 15:36:58 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Lock "cinder-quobyte-56cea113-9cb1-4203-bd4b-ec205a8325ec" released by "delete_volume" :: held 1.003s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Created reservations ['4bb67c65-3c03-47d0-8b38-9554a06030ae', '85fdd213-c77e-4f9e-8d44-a1744128eef8', '03fc932e-1d6f-445a-b2d3-b3556fc0bff0', '8576c22d-2a1f-418e-83fb-791b6adb75e0'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:58 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:58 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:58 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645" returned: 0 in 0.410s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:58 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 is being set with open permissions: ugo+rw Jul 17 15:36:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:58 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-af201928-bd5e-445f-8799-7b8f2a757448" returned: 0 in 0.369s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Lock "cinder-quobyte-af201928-bd5e-445f-8799-7b8f2a757448" released by "delete_volume" :: held 0.922s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:59 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 Jul 17 15:36:59 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Created reservations ['a193188b-1f1e-40e3-a63d-2558a4046b65', '86871476-614e-48e4-9523-6ec62850180b', '7e87be1e-657d-4e29-93af-aba4fef384ee', '137b501b-e7f8-4b65-96cf-55c82f5b31c6'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:36:59 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.301s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Deleted volume successfully. Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dff84c4a-2cf4-4933-be44-c820828e1168 tempest-VolumesImageMetadata-1432220602 None] Lock "cinder-56cea113-9cb1-4203-bd4b-ec205a8325ec-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:36:59 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:36:59 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:36:59 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645" returned: 0 in 0.342s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:36:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1c9d9194-c1dd-4472-aca7-c7276fd1c346 tempest-SnapshotsActionsTest-748878355 None] Create snapshot completed successfully Jul 17 15:36:59 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.314s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:36:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Deleted volume successfully. Jul 17 15:36:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f87fc4de-69bd-4769-9e2c-a08cf429f7bf tempest-ProjectReaderTests-1859064017 None] Lock "cinder-af201928-bd5e-445f-8799-7b8f2a757448-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-f3d08e8b-a497-42a7-8d09-ca7dd03d9645-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-f3d08e8b-a497-42a7-8d09-ca7dd03d9645-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-quobyte-f3d08e8b-a497-42a7-8d09-ca7dd03d9645" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-f3d08e8b-a497-42a7-8d09-ca7dd03d9645" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Deleting offline snapshot f3d08e8b-a497-42a7-8d09-ca7dd03d9645 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] snapshot_file for this snap is: volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[039858ca-51b8-4732-bc16-8da0d19461f6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Flow 'volume_create_manager' (27abf91e-b8ef-46c0-9031-e215a630ca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:01 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 Jul 17 15:37:01 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3bdc4d-85f1-4c61-9e9a-8e4221b9015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3bdc4d-85f1-4c61-9e9a-8e4221b9015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1883308065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb61d21-72b5-48ef-8e7c-d945af4ff26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804d2d9ce82437a86cabca8b2f7c7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:01Z,use_quota=True,user_id='8e08b620b3744e34a6547c927dd540da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36083db9-f157-4630-acbe-5cc4d42b4f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36083db9-f157-4630-acbe-5cc4d42b4f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e452baf-de4d-4da1-abfa-b36a92f7f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e452baf-de4d-4da1-abfa-b36a92f7f40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb61d21-72b5-48ef-8e7c-d945af4ff26e', 'volume_name': 'volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6657c7-010d-4f7c-b40f-cdbe4c5f38aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6657c7-010d-4f7c-b40f-cdbe4c5f38aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f781302-6264-4257-9671-0c22777c9b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:01 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Volume 8bb61d21-72b5-48ef-8e7c-d945af4ff26e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e', 'volume_size': 1} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1883308065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb61d21-72b5-48ef-8e7c-d945af4ff26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804d2d9ce82437a86cabca8b2f7c7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:01Z,use_quota=True,user_id='8e08b620b3744e34a6547c927dd540da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Creating volume 8bb61d21-72b5-48ef-8e7c-d945af4ff26e {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:37:01 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:01 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e 1073741824 Jul 17 15:37:01 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:01 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645" returned: 0 in 0.595s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[308adbf3-152f-4202-a7d5-0019cef8d58b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:01 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:01 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:01 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e 1073741824" returned: 0 in 0.658s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:01 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e Jul 17 15:37:01 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:02 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f781302-6264-4257-9671-0c22777c9b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:02 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1249005d-cdab-4080-b535-f314bba221d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.656s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:02 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Volume volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e (8bb61d21-72b5-48ef-8e7c-d945af4ff26e): created successfully Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1249005d-cdab-4080-b535-f314bba221d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:02 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 Jul 17 15:37:02 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Flow 'volume_create_manager' (27abf91e-b8ef-46c0-9031-e215a630ca3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7a049a23-ac64-4dc1-9d15-c92aaf62fcb0 tempest-ProjectReaderTests-1859064017 None] Created volume successfully. Jul 17 15:37:02 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645" returned: 0 in 0.500s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:02 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645 Jul 17 15:37:02 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:03 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f3d08e8b-a497-42a7-8d09-ca7dd03d9645" returned: 0 in 0.344s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "cinder-8bb61d21-72b5-48ef-8e7c-d945af4ff26e-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-f3d08e8b-a497-42a7-8d09-ca7dd03d9645" released by "_delete_snapshot" :: held 2.260s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" released by "delete_snapshot" :: held 2.313s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-8bb61d21-72b5-48ef-8e7c-d945af4ff26e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "cinder-quobyte-8bb61d21-72b5-48ef-8e7c-d945af4ff26e" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-quobyte-8bb61d21-72b5-48ef-8e7c-d945af4ff26e" acquired by "delete_volume" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Created reservations ['a387cf29-752f-4bde-b226-054ee567c150', '96ee0749-35cd-4c84-a223-934fe73064d0', '08e4170b-4d87-44e8-9872-1b9268d2f1c5', '90443d47-fc8c-4a1f-b1bd-2ce6170ee923'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74094c5-6c1c-452e-b985-1b8a93c33b2c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:03 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Delete snapshot completed successfully. Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-578e5c42-9ac2-4c92-bec1-e5e2f3e8a120 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-f3d08e8b-a497-42a7-8d09-ca7dd03d9645-delete_snapshot" released by "delete_snapshot" :: held 2.634s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:03 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e Jul 17 15:37:03 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:03 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e" returned: 0 in 0.512s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:03 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e Jul 17 15:37:03 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Flow 'volume_create_manager' (37c17443-92fb-46cf-8f65-736731499619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7afa5e2-4058-468d-a533-dceca1ffa060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7afa5e2-4058-468d-a533-dceca1ffa060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1208426922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd9e250-813e-457e-8c3e-4b30ffe2388e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d6469a00f4553b0e78abbc8ea921d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:04Z,use_quota=True,user_id='7fe9b75bd9234c378623609371e57610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea29289-c37e-4fef-8b16-c8e8d9ea1ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea29289-c37e-4fef-8b16-c8e8d9ea1ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211913e3-5e89-42e2-9046-e3902a68914d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211913e3-5e89-42e2-9046-e3902a68914d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd9e250-813e-457e-8c3e-4b30ffe2388e', 'volume_name': 'volume-efd9e250-813e-457e-8c3e-4b30ffe2388e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf11a45-2827-43ee-8834-e0a2e6be525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf11a45-2827-43ee-8834-e0a2e6be525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4529d3b1-8e29-4d7f-9789-65a571593a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:04 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Volume efd9e250-813e-457e-8c3e-4b30ffe2388e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd9e250-813e-457e-8c3e-4b30ffe2388e', 'volume_size': 1} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1208426922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd9e250-813e-457e-8c3e-4b30ffe2388e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d6469a00f4553b0e78abbc8ea921d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:04Z,use_quota=True,user_id='7fe9b75bd9234c378623609371e57610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Creating volume efd9e250-813e-457e-8c3e-4b30ffe2388e {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:04 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:37:04 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8bb61d21-72b5-48ef-8e7c-d945af4ff26e" returned: 0 in 0.417s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:04 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e 1073741824 Jul 17 15:37:04 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-quobyte-8bb61d21-72b5-48ef-8e7c-d945af4ff26e" released by "delete_volume" :: held 1.009s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Created reservations ['7ef86c81-3a27-413d-a902-3bf18833008c', '1bd1f04a-61c5-460a-935d-3eadfaa64f1a', 'f94fa470-1890-4efd-ad43-4f86ba65c071', '5d0b0dcf-77d3-4e9d-8ad2-a4fc40b60f3a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:04 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:37:04 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:04 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.387s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:37:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Deleted volume successfully. Jul 17 15:37:04 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a57b00cb-15b3-40ac-8056-c35118bfd3d0 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-8bb61d21-72b5-48ef-8e7c-d945af4ff26e-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e 1073741824" returned: 0 in 0.664s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:04 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e Jul 17 15:37:04 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:05 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e" returned: 0 in 0.306s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.660s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4529d3b1-8e29-4d7f-9789-65a571593a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd9e250-813e-457e-8c3e-4b30ffe2388e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf758d7-f777-4668-9ff8-c81bd7eb508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Creating offline snapshot 44226e68-5bdc-48df-b980-6730e5730385 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:37:05 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Volume volume-efd9e250-813e-457e-8c3e-4b30ffe2388e (efd9e250-813e-457e-8c3e-4b30ffe2388e): created successfully Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf758d7-f777-4668-9ff8-c81bd7eb508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Flow 'volume_create_manager' (37c17443-92fb-46cf-8f65-736731499619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (5593d6f8-5983-4f3e-b87b-5c70c967418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df669e61-183b-44f9-bbf9-de3f3570dbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ee386f-8bf1-4407-8963-f3edb7da4aa4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:05 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a54162e5-c6be-4691-9d6f-cd116024fdd8 tempest-SnapshotMetadataTestJSON-50698097 None] Created volume successfully. Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df669e61-183b-44f9-bbf9-de3f3570dbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1870850736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1724ff5b-8ada-4fa5-93a8-5d6af8d8d433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b95c1fcafe743fb8306779a1efd61fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:05Z,use_quota=True,user_id='13b2a973aafd447ea84c486368d3fa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc5537a-d746-4a7a-8f4b-81e1f5ce7572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc5537a-d746-4a7a-8f4b-81e1f5ce7572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59519f86-5d09-4059-a82c-e062ed919a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59519f86-5d09-4059-a82c-e062ed919a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1724ff5b-8ada-4fa5-93a8-5d6af8d8d433', 'volume_name': 'volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c2fbf0-85e6-4854-b22d-a966e039d974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c2fbf0-85e6-4854-b22d-a966e039d974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c7cb32-4fd7-4132-807b-417f2724ed3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:05 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Volume 1724ff5b-8ada-4fa5-93a8-5d6af8d8d433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433', 'volume_size': 1} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:05 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:05 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:05 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.418s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:05 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 1G Jul 17 15:37:05 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Flow 'volume_create_manager' (32b0a9f3-b4b0-4abb-bdff-4bf02ddde94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201210a4-e9d8-49e1-9f31-85373ca5f1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201210a4-e9d8-49e1-9f31-85373ca5f1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2041032753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28d93d1-036b-4530-b2a8-ac66fa035391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804d2d9ce82437a86cabca8b2f7c7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:06Z,use_quota=True,user_id='8e08b620b3744e34a6547c927dd540da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851d1e17-82aa-412a-a47e-ce4d3e1970d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851d1e17-82aa-412a-a47e-ce4d3e1970d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e998f1-5c51-410a-9b45-869cf3c370a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e998f1-5c51-410a-9b45-869cf3c370a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28d93d1-036b-4530-b2a8-ac66fa035391', 'volume_name': 'volume-d28d93d1-036b-4530-b2a8-ac66fa035391', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd50900-5a18-4899-b7ed-657aa0868179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd50900-5a18-4899-b7ed-657aa0868179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e5e45a-d2dd-4669-b181-74f33d1791b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:06 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Volume d28d93d1-036b-4530-b2a8-ac66fa035391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28d93d1-036b-4530-b2a8-ac66fa035391', 'volume_size': 1} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:06 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 1G" returned: 0 in 0.471s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:06 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 Jul 17 15:37:06 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:06 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385" returned: 0 in 0.308s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:06 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 is being set with open permissions: ugo+rw Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:06 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 Jul 17 15:37:06 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:06 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385" returned: 0 in 0.254s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.605s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.378s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1870850736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1724ff5b-8ada-4fa5-93a8-5d6af8d8d433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b95c1fcafe743fb8306779a1efd61fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:05Z,use_quota=True,user_id='13b2a973aafd447ea84c486368d3fa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Creating volume 1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:37:06 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:37:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:06 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 1073741824 Jul 17 15:37:06 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c9e59630-4bea-4429-aa9a-ff2f763935e6 tempest-SnapshotsActionsTest-748878355 None] Create snapshot completed successfully Jul 17 15:37:07 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 1073741824" returned: 0 in 0.424s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:07 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 Jul 17 15:37:07 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:07 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" returned: 0 in 0.253s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2041032753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28d93d1-036b-4530-b2a8-ac66fa035391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804d2d9ce82437a86cabca8b2f7c7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:06Z,use_quota=True,user_id='8e08b620b3744e34a6547c927dd540da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Creating volume d28d93d1-036b-4530-b2a8-ac66fa035391 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:37:07 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c7cb32-4fd7-4132-807b-417f2724ed3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:07 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391 1073741824 Jul 17 15:37:07 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b3d015-b0e0-4d4f-81f7-904b488d3e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:07 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Volume volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 (1724ff5b-8ada-4fa5-93a8-5d6af8d8d433): created successfully Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b3d015-b0e0-4d4f-81f7-904b488d3e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (5593d6f8-5983-4f3e-b87b-5c70c967418c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:07 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-95be8eb5-0ade-4286-841a-b9558066b052 tempest-VolumesSnapshotTestJSON-837647410 None] Created volume successfully. Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-44226e68-5bdc-48df-b980-6730e5730385-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-44226e68-5bdc-48df-b980-6730e5730385-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-quobyte-44226e68-5bdc-48df-b980-6730e5730385" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-44226e68-5bdc-48df-b980-6730e5730385" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Deleting offline snapshot 44226e68-5bdc-48df-b980-6730e5730385 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] snapshot_file for this snap is: volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4166539d-84ad-49d2-b03c-6121eaef9fe7]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:07 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 Jul 17 15:37:07 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:07 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391 1073741824" returned: 0 in 0.479s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:08 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391 Jul 17 15:37:08 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:08 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385" returned: 0 in 0.392s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edbf009-6028-4219-ba22-160f676279d2]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:08 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391" returned: 0 in 0.275s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.969s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e5e45a-d2dd-4669-b181-74f33d1791b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28d93d1-036b-4530-b2a8-ac66fa035391', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd6979f-bea5-49dc-944f-8164b971495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Creating offline snapshot e10f6db3-3f69-4ace-9f19-64f78c2cecc8 of volume efd9e250-813e-457e-8c3e-4b30ffe2388e {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:37:08 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Volume volume-d28d93d1-036b-4530-b2a8-ac66fa035391 (d28d93d1-036b-4530-b2a8-ac66fa035391): created successfully Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd6979f-bea5-49dc-944f-8164b971495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Flow 'volume_create_manager' (32b0a9f3-b4b0-4abb-bdff-4bf02ddde94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfe0adb-fa57-4847-a22b-8c9fb7a30078]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:08 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:08 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:08 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5b7597b9-86b1-4694-9877-974c43571aea tempest-ProjectReaderTests-1859064017 None] Created volume successfully. Jul 17 15:37:08 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e Jul 17 15:37:08 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:08 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.429s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:08 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 Jul 17 15:37:08 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:08 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e" returned: 0 in 0.404s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:08 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 1G Jul 17 15:37:08 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:09 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385" returned: 0 in 0.415s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "cinder-d28d93d1-036b-4530-b2a8-ac66fa035391-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:09 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385 Jul 17 15:37:09 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-d28d93d1-036b-4530-b2a8-ac66fa035391-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "cinder-quobyte-d28d93d1-036b-4530-b2a8-ac66fa035391" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-quobyte-d28d93d1-036b-4530-b2a8-ac66fa035391" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eb4fa7-e42f-4efc-8806-b430f9a9007e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:09 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 1G" returned: 0 in 0.494s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd9e250-813e-457e-8c3e-4b30ffe2388e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:09 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd9e250-813e-457e-8c3e-4b30ffe2388e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 Jul 17 15:37:09 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:09 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391 Jul 17 15:37:09 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:09 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.44226e68-5bdc-48df-b980-6730e5730385" returned: 0 in 0.284s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-44226e68-5bdc-48df-b980-6730e5730385" released by "_delete_snapshot" :: held 1.639s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" released by "delete_snapshot" :: held 1.666s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Created reservations ['aa2e6345-9fe6-46da-83ba-6f8bef3a94cf', 'f9d3f76d-6b29-4b66-9d70-6e27eb5d3884', '0fa7254b-7ecb-43c0-96c4-b274d200b4ea', 'dd24c346-5216-45a5-9fa1-579cd0100a06'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Delete snapshot completed successfully. Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8fd2c1e0-8c77-4156-9dab-63142b4ae752 tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-44226e68-5bdc-48df-b980-6730e5730385-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:09 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efd9e250-813e-457e-8c3e-4b30ffe2388e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8" returned: 0 in 0.345s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:09 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 is being set with open permissions: ugo+rw Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:09 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391" returned: 0 in 0.403s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:09 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 Jul 17 15:37:09 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:09 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391 Jul 17 15:37:09 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:09 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8" returned: 0 in 0.274s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:09 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.info Jul 17 15:37:09 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:09 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d28d93d1-036b-4530-b2a8-ac66fa035391" returned: 0 in 0.333s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-quobyte-d28d93d1-036b-4530-b2a8-ac66fa035391" released by "delete_volume" :: held 0.788s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Created reservations ['88eba651-77c7-4eaf-b3fa-19b07f289029', '92dce203-1b39-4b20-96f2-56f0ca3b20ff', 'e0d5e46a-bdf2-444a-9822-6dc69bbd29cd', '67bf863a-b30e-4d2a-b5c7-95793a08a01a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:10 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:37:10 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:10 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.info" returned: 0 in 0.307s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:10 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.info is being set with open permissions: ugo+rw Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:10 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.info Jul 17 15:37:10 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:10 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.309s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:37:10 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Deleted volume successfully. Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f9578481-bf03-42a1-ac76-ce501c1e0e91 tempest-ProjectReaderTests-1859064017 None] Lock "cinder-d28d93d1-036b-4530-b2a8-ac66fa035391-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:10 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.info" returned: 0 in 0.283s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.964s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Creating offline snapshot 98ef8715-93c5-42ca-9d21-b9744f7e32e2 of volume 1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:37:10 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b3be35b8-cdfb-49da-8c48-063960995790 tempest-SnapshotMetadataTestJSON-50698097 None] Create snapshot completed successfully Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f29e5d-c297-4b06-b3ef-6af1f45317a0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:10 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 Jul 17 15:37:10 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:10 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" returned: 0 in 0.392s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:10 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 1G Jul 17 15:37:10 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:11 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 1G" returned: 0 in 0.448s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:11 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 Jul 17 15:37:11 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:11 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2" returned: 0 in 0.356s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:11 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 is being set with open permissions: ugo+rw Jul 17 15:37:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:11 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 Jul 17 15:37:11 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:12 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2" returned: 0 in 0.297s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:12 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.info Jul 17 15:37:12 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Acquiring lock "cinder-e10f6db3-3f69-4ace-9f19-64f78c2cecc8-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:12 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-e10f6db3-3f69-4ace-9f19-64f78c2cecc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Acquiring lock "cinder-quobyte-efd9e250-813e-457e-8c3e-4b30ffe2388e" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.info" returned: 0 in 0.285s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:12 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.info is being set with open permissions: ugo+rw Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-quobyte-efd9e250-813e-457e-8c3e-4b30ffe2388e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Acquiring lock "cinder-quobyte-e10f6db3-3f69-4ace-9f19-64f78c2cecc8" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:12 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.info Jul 17 15:37:12 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-quobyte-e10f6db3-3f69-4ace-9f19-64f78c2cecc8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Deleting offline snapshot e10f6db3-3f69-4ace-9f19-64f78c2cecc8 of volume efd9e250-813e-457e-8c3e-4b30ffe2388e {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] snapshot_file for this snap is: volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d56d37-bbb8-4398-a26f-f437328a44c2]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:12 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 Jul 17 15:37:12 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:12 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.info" returned: 0 in 0.249s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.420s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Creating offline snapshot 75a624e4-805b-467d-b321-dd0a6f718534 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e820361-0d83-45e2-bbe0-76008a5e4d27]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:12 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0dd9e111-43ae-4067-9827-5eb50c458dd6 tempest-VolumesSnapshotTestJSON-837647410 None] Create snapshot completed successfully Jul 17 15:37:12 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8" returned: 0 in 0.406s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efd9e250-813e-457e-8c3e-4b30ffe2388e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:12 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:12 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[83831a12-c6a1-4d2b-a474-6ff69a65c0cd]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:13 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e Jul 17 15:37:13 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:13 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.381s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:13 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 1G Jul 17 15:37:13 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:13 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e" returned: 0 in 0.349s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:13 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 Jul 17 15:37:13 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:13 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 1G" returned: 0 in 0.443s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:13 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 Jul 17 15:37:13 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:13 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8" returned: 0 in 0.370s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:13 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8 Jul 17 15:37:13 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:13 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e.e10f6db3-3f69-4ace-9f19-64f78c2cecc8" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:13 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534" returned: 0 in 0.340s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:13 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 is being set with open permissions: ugo+rw Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-quobyte-e10f6db3-3f69-4ace-9f19-64f78c2cecc8" released by "_delete_snapshot" :: held 1.505s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-quobyte-efd9e250-813e-457e-8c3e-4b30ffe2388e" released by "delete_snapshot" :: held 1.531s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:13 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 Jul 17 15:37:13 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-98ef8715-93c5-42ca-9d21-b9744f7e32e2-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:13 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-98ef8715-93c5-42ca-9d21-b9744f7e32e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Created reservations ['cbf6570d-99c4-45d7-836e-4e105455c0d7', '002f4d02-6992-4f20-8707-3142fda34239', '06e7e672-4ec7-451f-823b-9b510187a9de', '5ac6e823-8a51-4845-9913-867c65ea2a0f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-98ef8715-93c5-42ca-9d21-b9744f7e32e2" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-98ef8715-93c5-42ca-9d21-b9744f7e32e2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Deleting offline snapshot 98ef8715-93c5-42ca-9d21-b9744f7e32e2 of volume 1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] snapshot_file for this snap is: volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eea6ac-24a8-438b-a672-308495d8ef94]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Delete snapshot completed successfully. Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-764a1325-b587-424d-bc43-6e0540c80926 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-e10f6db3-3f69-4ace-9f19-64f78c2cecc8-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:14 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534" returned: 0 in 0.264s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.547s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-80c5fbd8-e176-4d63-92de-616e1525c664 tempest-SnapshotsActionsTest-748878355 None] Create snapshot completed successfully Jul 17 15:37:14 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 Jul 17 15:37:14 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-75a624e4-805b-467d-b321-dd0a6f718534-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-75a624e4-805b-467d-b321-dd0a6f718534-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:14 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2" returned: 0 in 0.408s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-quobyte-75a624e4-805b-467d-b321-dd0a6f718534" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad4034b-eb0d-4f12-972d-9d3f90df9634]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-75a624e4-805b-467d-b321-dd0a6f718534" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Deleting offline snapshot 75a624e4-805b-467d-b321-dd0a6f718534 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] snapshot_file for this snap is: volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f78e2e-a1b6-40c1-a092-d64b4c226d48]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Acquiring lock "cinder-efd9e250-813e-457e-8c3e-4b30ffe2388e-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-efd9e250-813e-457e-8c3e-4b30ffe2388e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Acquiring lock "cinder-quobyte-efd9e250-813e-457e-8c3e-4b30ffe2388e" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-quobyte-efd9e250-813e-457e-8c3e-4b30ffe2388e" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:14 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 Jul 17 15:37:14 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bff4f3c-e1d0-491a-8f92-c11faf08e02c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:14 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 Jul 17 15:37:14 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:14 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e Jul 17 15:37:14 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:14 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" returned: 0 in 0.395s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:15 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 Jul 17 15:37:15 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:15 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534" returned: 0 in 0.417s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb75559-79c7-440d-a642-c863c4418d76]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:15 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e" returned: 0 in 0.408s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:15 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:15 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:15 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e Jul 17 15:37:15 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:15 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2" returned: 0 in 0.370s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:15 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2 Jul 17 15:37:15 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:15 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-efd9e250-813e-457e-8c3e-4b30ffe2388e" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-quobyte-efd9e250-813e-457e-8c3e-4b30ffe2388e" released by "delete_volume" :: held 0.715s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:15 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.402s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:15 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 Jul 17 15:37:15 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Created reservations ['d836d32f-8d0a-4ebc-8731-d88064a686c8', '6cfd5529-5ee7-4bf9-8584-958b79383195', 'a1ada5d2-cd3d-478c-abeb-dfeb4ed31869', '52407e8c-6325-4878-ac0e-5d6493765a10'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:15 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:37:15 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:15 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433.98ef8715-93c5-42ca-9d21-b9744f7e32e2" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-98ef8715-93c5-42ca-9d21-b9744f7e32e2" released by "_delete_snapshot" :: held 1.629s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" released by "delete_snapshot" :: held 1.662s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Created reservations ['1b1a9e33-24a2-41f2-ab76-639e306daddd', '78fdb526-73bc-4608-8a1f-f99e8317025a', '4c13d7b9-19b0-4819-be23-592c15ebb8c0', 'd7aa7c95-73dc-4b3c-b35f-9cd4695cbe97'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Delete snapshot completed successfully. Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8e28859-45a0-4b03-a422-faf56e45f419 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-98ef8715-93c5-42ca-9d21-b9744f7e32e2-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:15 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:37:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Deleted volume successfully. Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ef50eee-32a4-4701-85c2-c5ab032d8221 tempest-SnapshotMetadataTestJSON-50698097 None] Lock "cinder-efd9e250-813e-457e-8c3e-4b30ffe2388e-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:15 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534" returned: 0 in 0.512s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:16 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534 Jul 17 15:37:16 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:16 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.75a624e4-805b-467d-b321-dd0a6f718534" returned: 0 in 0.270s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-75a624e4-805b-467d-b321-dd0a6f718534" released by "_delete_snapshot" :: held 1.720s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" released by "delete_snapshot" :: held 1.749s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Created reservations ['4b3a160b-72ee-42c3-a830-b38e1e6e54b2', 'd5953c3e-c9c5-44bc-bf05-3b600a0a5699', '8c912935-7b5b-41b8-b766-a12af57d19f6', '08111a37-5b9d-4de2-b121-612ed09c031b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Delete snapshot completed successfully. Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a6e91f0-a690-4088-9dad-9805d25e541f tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-75a624e4-805b-467d-b321-dd0a6f718534-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (f3abc9ed-34dd-4d77-a0f6-ba3f8fde8991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec9c53d-0589-475e-bca7-10fa8420d06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec9c53d-0589-475e-bca7-10fa8420d06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2105622377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca55892-1280-439b-8d3c-932e5502510b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b95c1fcafe743fb8306779a1efd61fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:17Z,use_quota=True,user_id='13b2a973aafd447ea84c486368d3fa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a52b2ab-4e1a-4d14-88c5-e84d960555a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a52b2ab-4e1a-4d14-88c5-e84d960555a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677601bb-930b-4460-a51b-5ef4feda4066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677601bb-930b-4460-a51b-5ef4feda4066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca55892-1280-439b-8d3c-932e5502510b', 'volume_name': 'volume-8ca55892-1280-439b-8d3c-932e5502510b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb06c01-b6e4-410d-9289-c377ca6b3756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb06c01-b6e4-410d-9289-c377ca6b3756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2e118f-ceef-4619-a48b-5979eff5b296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:16 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Volume 8ca55892-1280-439b-8d3c-932e5502510b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca55892-1280-439b-8d3c-932e5502510b', 'volume_size': 1} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2105622377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca55892-1280-439b-8d3c-932e5502510b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b95c1fcafe743fb8306779a1efd61fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:17Z,use_quota=True,user_id='13b2a973aafd447ea84c486368d3fa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Creating volume 8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:37:16 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:37:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:16 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b 1073741824 Jul 17 15:37:16 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:17 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b 1073741824" returned: 0 in 0.495s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:17 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b Jul 17 15:37:17 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:17 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b" returned: 0 in 0.249s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.587s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Creating offline snapshot 1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2e118f-ceef-4619-a48b-5979eff5b296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca55892-1280-439b-8d3c-932e5502510b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d58553-1bb9-4c3d-bbc7-7ffc13594654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2318a1cc-67fb-4e19-bd7f-1bbdab823de9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:17 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Volume volume-8ca55892-1280-439b-8d3c-932e5502510b (8ca55892-1280-439b-8d3c-932e5502510b): created successfully Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d58553-1bb9-4c3d-bbc7-7ffc13594654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (f3abc9ed-34dd-4d77-a0f6-ba3f8fde8991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:17 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b891a6e6-bae2-46a0-8eea-a93f10504a13 tempest-VolumesSnapshotTestJSON-837647410 None] Created volume successfully. Jul 17 15:37:17 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:17 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:18 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.393s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:18 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 1G Jul 17 15:37:18 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:18 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 1G" returned: 0 in 0.478s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:18 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 Jul 17 15:37:18 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:18 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73" returned: 0 in 0.332s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:18 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 is being set with open permissions: ugo+rw Jul 17 15:37:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:18 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 Jul 17 15:37:18 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:19 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73" returned: 0 in 0.282s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.597s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.178s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Creating offline snapshot 64ac07ce-d0b0-4d61-a698-9c596552ffb7 of volume 8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:37:19 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-29df93f2-129b-4f10-a983-97657c51a951 tempest-SnapshotsActionsTest-748878355 None] Create snapshot completed successfully Jul 17 15:37:19 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad1afed-e511-4e30-925c-472eccfe62a7]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:19 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b Jul 17 15:37:19 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:19 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b" returned: 0 in 0.407s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:19 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 1G Jul 17 15:37:19 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:20 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 1G" returned: 0 in 0.442s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca55892-1280-439b-8d3c-932e5502510b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:20 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca55892-1280-439b-8d3c-932e5502510b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 Jul 17 15:37:20 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-1d3d7ce4-47ab-48be-81a6-cef2dbe79f73-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-1d3d7ce4-47ab-48be-81a6-cef2dbe79f73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Acquiring lock "cinder-quobyte-1d3d7ce4-47ab-48be-81a6-cef2dbe79f73" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-1d3d7ce4-47ab-48be-81a6-cef2dbe79f73" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Deleting offline snapshot 1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] snapshot_file for this snap is: volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e32fab1-56af-4ded-84b0-a769c4264710]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:20 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca55892-1280-439b-8d3c-932e5502510b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7" returned: 0 in 0.332s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:20 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 is being set with open permissions: ugo+rw Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:20 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 Jul 17 15:37:20 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:20 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 Jul 17 15:37:20 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:20 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7" returned: 0 in 0.324s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:20 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73" returned: 0 in 0.454s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:20 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.info Jul 17 15:37:20 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[358443ca-77a7-44e5-9b3c-2f7101072f91]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:21 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:21 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:21 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.info" returned: 0 in 0.312s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:21 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.info is being set with open permissions: ugo+rw Jul 17 15:37:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:21 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.info Jul 17 15:37:21 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:21 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.403s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:21 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 Jul 17 15:37:21 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:21 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.info" returned: 0 in 0.271s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7ead861b-0d01-4352-adf1-4bdc5f2918bd tempest-VolumesSnapshotTestJSON-837647410 None] Create snapshot completed successfully Jul 17 15:37:21 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73" returned: 0 in 0.411s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:21 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73 Jul 17 15:37:21 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:21 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.1d3d7ce4-47ab-48be-81a6-cef2dbe79f73" returned: 0 in 0.296s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-1d3d7ce4-47ab-48be-81a6-cef2dbe79f73" released by "_delete_snapshot" :: held 1.690s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" released by "delete_snapshot" :: held 1.729s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Created reservations ['89cf9e74-a916-4925-85b1-d6ae29618971', 'd842cf28-710a-41db-be77-6fbc435423d0', 'd13498b4-fe1a-46b2-9d3a-8f9b3d890d42', '51e9277b-7931-449c-9e98-2a89d3909955'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Delete snapshot completed successfully. Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81210ad9-ad4e-4194-bb20-81c74ded305d tempest-SnapshotsActionsTest-1323644677 None] Lock "cinder-1d3d7ce4-47ab-48be-81a6-cef2dbe79f73-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:22 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:37:22 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (8d4e6ff6-f690-4990-8f03-9625ad91ecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e24ac0-0747-4f5e-b7d5-464bccfcd5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "cinder-f76093e4-3196-4c3c-820e-78d73f00e2b2-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e24ac0-0747-4f5e-b7d5-464bccfcd5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2096943622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7dd3dd-053e-4c44-8de1-228ee6e9212e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b95c1fcafe743fb8306779a1efd61fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=64ac07ce-d0b0-4d61-a698-9c596552ffb7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:23Z,use_quota=True,user_id='13b2a973aafd447ea84c486368d3fa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354f67c8-2dca-43a9-993b-7642db35f9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354f67c8-2dca-43a9-993b-7642db35f9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530305dc-79a8-4215-8fb9-000f2f7531b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530305dc-79a8-4215-8fb9-000f2f7531b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c7dd3dd-053e-4c44-8de1-228ee6e9212e', 'volume_name': 'volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e', 'volume_size': 2, 'snapshot_id': '64ac07ce-d0b0-4d61-a698-9c596552ffb7'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f11192b-fc08-4050-8ffa-e0ba4f899387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f11192b-fc08-4050-8ffa-e0ba4f899387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d82b084-4bfa-46f3-ad3b-e2967117d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:22 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Volume 7c7dd3dd-053e-4c44-8de1-228ee6e9212e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e', 'volume_size': 2, 'snapshot_id': '64ac07ce-d0b0-4d61-a698-9c596552ffb7'} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-f76093e4-3196-4c3c-820e-78d73f00e2b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-64ac07ce-d0b0-4d61-a698-9c596552ffb7-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" by "_create_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "cinder-quobyte-f76093e4-3196-4c3c-820e-78d73f00e2b2" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-64ac07ce-d0b0-4d61-a698-9c596552ffb7-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Creating volume 7c7dd3dd-053e-4c44-8de1-228ee6e9212e from snapshot 64ac07ce-d0b0-4d61-a698-9c596552ffb7 {{(pid=87769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-quobyte-f76093e4-3196-4c3c-820e-78d73f00e2b2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Deleting offline snapshot f76093e4-3196-4c3c-820e-78d73f00e2b2 of volume 50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] snapshot_file for this snap is: volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:37:23 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.330s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] snapshot: 64ac07ce-d0b0-4d61-a698-9c596552ffb7, volume: 7c7dd3dd-053e-4c44-8de1-228ee6e9212e, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac629eb-98c2-4da2-90b1-f0fe25e6bcb3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27ea86a-6255-417d-8ac1-ab1ff385abc0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:23 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:23 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:23 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 Jul 17 15:37:23 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:23 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.497s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f62384-4261-495e-a61b-ffe5444c4538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0b9bf7-4af3-431c-bb49-4fa0d976fdb1]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:23 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7" returned: 0 in 0.536s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca55892-1280-439b-8d3c-932e5502510b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a2af66-ba2c-4ed7-92f3-65ac8c72e25c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:23 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 Jul 17 15:37:23 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:23 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b Jul 17 15:37:23 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:24 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538" returned: 0 in 0.507s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:24 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:24 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:24 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b" returned: 0 in 0.458s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:24 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:37:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:24 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e Jul 17 15:37:24 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:24 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.444s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:24 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2 Jul 17 15:37:24 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:25 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538.f76093e4-3196-4c3c-820e-78d73f00e2b2" returned: 0 in 0.482s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-quobyte-f76093e4-3196-4c3c-820e-78d73f00e2b2" released by "_delete_snapshot" :: held 2.172s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" released by "delete_snapshot" :: held 2.214s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:25 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Created reservations ['e8ab4a93-af1b-48ea-92e0-ed3e49bf95bf', '12b91c19-af59-444f-8c18-5e5df0bb1236', '7809ccfb-de17-4548-874c-47ef04d06162', '09de067e-643e-4f91-b855-d977f162190f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Delete snapshot completed successfully. Jul 17 15:37:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba3a0db4-0b28-4aa3-a073-9c4c362f8f59 tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-f76093e4-3196-4c3c-820e-78d73f00e2b2-delete_snapshot" released by "delete_snapshot" :: held 2.664s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "cinder-50f62384-4261-495e-a61b-ffe5444c4538-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-50f62384-4261-495e-a61b-ffe5444c4538-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" acquired by "delete_volume" :: waited 0.057s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:26 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[176c40d5-cf8f-4f92-ab00-2d7d9ff179c4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:26 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 Jul 17 15:37:26 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:27 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538" returned: 0 in 0.849s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:27 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538 Jul 17 15:37:27 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:28 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-50f62384-4261-495e-a61b-ffe5444c4538" returned: 0 in 0.514s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-quobyte-50f62384-4261-495e-a61b-ffe5444c4538" released by "delete_volume" :: held 1.543s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:28 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Created reservations ['d62d98d7-6d26-4e1e-b22e-5b63c2120fa6', '5580fd60-76bf-4de2-aebd-29efc4c282c0', '8c855fa4-4640-4a24-bef8-3301c0e2a801', '1e499c2c-0701-42dc-ac4a-780a014fd625'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:28 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:37:28 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:29 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.413s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:29 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:37:29 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Deleted volume successfully. Jul 17 15:37:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-153b9e47-8904-410c-9de5-655b69a9fe4c tempest-SnapshotsActionsTest-748878355 None] Lock "cinder-50f62384-4261-495e-a61b-ffe5444c4538-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:30 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" returned: 0 in 6.001s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:30 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1250c6e7-5fa7-4789-a99d-25733c8948f3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:30 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b Jul 17 15:37:30 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:30 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b" returned: 0 in 0.674s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:30 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:37:30 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Converted 1024.00 MB image at 170.60 MB/s Jul 17 15:37:30 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e is being set with open permissions: ugo+rw Jul 17 15:37:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:30 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e Jul 17 15:37:30 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:31 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" returned: 0 in 0.281s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" released by "_copy_volume_from_snapshot" :: held 8.118s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-64ac07ce-d0b0-4d61-a698-9c596552ffb7-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" released by "_create_volume_from_snapshot" :: held 8.188s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.212s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d82b084-4bfa-46f3-ad3b-e2967117d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e', 'volume_size': 2, 'snapshot_id': '64ac07ce-d0b0-4d61-a698-9c596552ffb7'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3bf9b6-f0b4-44c5-8f40-08faa2a224e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:31 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Volume volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e (7c7dd3dd-053e-4c44-8de1-228ee6e9212e): created successfully Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3bf9b6-f0b4-44c5-8f40-08faa2a224e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (8d4e6ff6-f690-4990-8f03-9625ad91ecfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:31 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-94ad934a-36d7-420f-8a29-46d9dc7edd5f tempest-VolumesSnapshotTestJSON-837647410 None] Created volume successfully. Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Flow 'volume_create_manager' (e37e7e3f-6915-4e21-b021-ed24b53a946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592fa829-c634-430e-bf0a-974a3e264a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592fa829-c634-430e-bf0a-974a3e264a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-884721961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15440c15-5d97-4615-b06b-e7fb29fa1138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c184ebfaac4b8e99b957f2ff85e214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:32Z,use_quota=True,user_id='0dfe72deab7f49bfad9ae13bd2df60b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02d69a3-8253-448f-aaf5-b8833f34efb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02d69a3-8253-448f-aaf5-b8833f34efb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931aa7dc-1f4d-49fd-9564-b925ae2e1055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931aa7dc-1f4d-49fd-9564-b925ae2e1055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15440c15-5d97-4615-b06b-e7fb29fa1138', 'volume_name': 'volume-15440c15-5d97-4615-b06b-e7fb29fa1138', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e381f61-90c1-4241-8598-66c1d8a1886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e381f61-90c1-4241-8598-66c1d8a1886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd4af0a-b744-466c-9b41-bab4bd12edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:31 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Volume 15440c15-5d97-4615-b06b-e7fb29fa1138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15440c15-5d97-4615-b06b-e7fb29fa1138', 'volume_size': 1} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-884721961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15440c15-5d97-4615-b06b-e7fb29fa1138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c184ebfaac4b8e99b957f2ff85e214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:32Z,use_quota=True,user_id='0dfe72deab7f49bfad9ae13bd2df60b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Creating volume 15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:37:31 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:31 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 1073741824 Jul 17 15:37:31 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-7c7dd3dd-053e-4c44-8de1-228ee6e9212e-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-7c7dd3dd-053e-4c44-8de1-228ee6e9212e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[448abc9b-d53d-452f-abf8-c11b6d56c42d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:32 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e Jul 17 15:37:32 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:32 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 1073741824" returned: 0 in 0.570s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:32 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 Jul 17 15:37:32 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:32 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" returned: 0 in 0.434s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:32 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e Jul 17 15:37:32 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:32 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138" returned: 0 in 0.284s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd4af0a-b744-466c-9b41-bab4bd12edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15440c15-5d97-4615-b06b-e7fb29fa1138', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99eab7ef-7a39-4a5c-8faa-7e7ed2430327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:32 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Volume volume-15440c15-5d97-4615-b06b-e7fb29fa1138 (15440c15-5d97-4615-b06b-e7fb29fa1138): created successfully Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99eab7ef-7a39-4a5c-8faa-7e7ed2430327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Flow 'volume_create_manager' (e37e7e3f-6915-4e21-b021-ed24b53a946e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4dfa7035-d2ff-4f2a-97b1-9671a1041f3d tempest-VolumesActionsTest-1617482551 None] Created volume successfully. Jul 17 15:37:32 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" returned: 0 in 0.282s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-7c7dd3dd-053e-4c44-8de1-228ee6e9212e" released by "delete_volume" :: held 0.765s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Created reservations ['781fb55b-8117-4de6-8858-1d0d38096a7a', '0a8b63e3-5025-4568-b94a-d54d572e725b', 'ff39af75-8969-4800-bf34-f57f0d160294', '7e8125a8-c721-4acf-bc4a-eb0ceaa7972a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:33 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:37:33 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-64ac07ce-d0b0-4d61-a698-9c596552ffb7-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-64ac07ce-d0b0-4d61-a698-9c596552ffb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-8ca55892-1280-439b-8d3c-932e5502510b" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-8ca55892-1280-439b-8d3c-932e5502510b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-64ac07ce-d0b0-4d61-a698-9c596552ffb7" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:33 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.283s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-64ac07ce-d0b0-4d61-a698-9c596552ffb7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Deleting offline snapshot 64ac07ce-d0b0-4d61-a698-9c596552ffb7 of volume 8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] snapshot_file for this snap is: volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:37:33 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Deleted volume successfully. Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d16fcbe-2e5b-453a-a5c1-69dd4e9ca2d9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0e104b6a-db21-4739-97bb-11af8c22a385 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-7c7dd3dd-053e-4c44-8de1-228ee6e9212e-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:33 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 Jul 17 15:37:33 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:33 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7" returned: 0 in 0.421s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca55892-1280-439b-8d3c-932e5502510b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacc991d-2fe8-429b-a7fa-abce591913a6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:33 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b Jul 17 15:37:33 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:34 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b" returned: 0 in 0.400s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:34 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 Jul 17 15:37:34 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:34 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7" returned: 0 in 0.409s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:34 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7 Jul 17 15:37:34 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:34 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b.64ac07ce-d0b0-4d61-a698-9c596552ffb7" returned: 0 in 0.283s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-64ac07ce-d0b0-4d61-a698-9c596552ffb7" released by "_delete_snapshot" :: held 1.641s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-8ca55892-1280-439b-8d3c-932e5502510b" released by "delete_snapshot" :: held 1.673s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:35 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Created reservations ['a90b151a-ccf6-4602-bdc8-dcb742035522', '83647f02-6957-4741-a813-9fa400c07f7b', '5d2eb14a-57e6-4640-86eb-e0faada0a06f', '83e097d6-5ebb-426c-8924-94b0f0cac5b1'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:35 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Delete snapshot completed successfully. Jul 17 15:37:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8541fa7-de99-4003-99df-2fddf6f90d4d tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-64ac07ce-d0b0-4d61-a698-9c596552ffb7-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-8ca55892-1280-439b-8d3c-932e5502510b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-8ca55892-1280-439b-8d3c-932e5502510b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-8ca55892-1280-439b-8d3c-932e5502510b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-8ca55892-1280-439b-8d3c-932e5502510b" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:35 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bed708-b945-465e-b5c7-ffd1283e5b5f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:35 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b Jul 17 15:37:35 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:36 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b" returned: 0 in 0.418s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:36 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b Jul 17 15:37:36 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:36 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8ca55892-1280-439b-8d3c-932e5502510b" returned: 0 in 0.251s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-8ca55892-1280-439b-8d3c-932e5502510b" released by "delete_volume" :: held 0.754s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Created reservations ['2930a989-ec41-4562-a362-0aa29b8c7856', '53ca7332-8aef-4cfe-8b17-34bc51a401cc', '47ea992b-0da0-4f00-8b2b-575ca55dae0c', '0082a4d3-0a32-480b-b414-fecae70032c7'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:36 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:37:36 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:36 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.346s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:37:36 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Deleted volume successfully. Jul 17 15:37:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1632b37-f485-4bfe-9078-7e13aafb0fb6 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-8ca55892-1280-439b-8d3c-932e5502510b-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (85b8c81d-8dee-4ae1-bef6-6912516493cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c3976c-ecf1-49f0-8f85-b4eeb5bc83aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c3976c-ecf1-49f0-8f85-b4eeb5bc83aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1045165215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a5336d-f79d-401f-b222-823eecee94ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b95c1fcafe743fb8306779a1efd61fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:37Z,use_quota=True,user_id='13b2a973aafd447ea84c486368d3fa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca474516-2e29-42c4-9856-e9b8ceb71999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca474516-2e29-42c4-9856-e9b8ceb71999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f2baee-d69c-475e-81a0-e95d480f3847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f2baee-d69c-475e-81a0-e95d480f3847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a5336d-f79d-401f-b222-823eecee94ca', 'volume_name': 'volume-d4a5336d-f79d-401f-b222-823eecee94ca', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a0b89d-7458-4b7f-a534-f33fea1d8fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a0b89d-7458-4b7f-a534-f33fea1d8fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba194201-32b4-4c40-b2cd-c8541d4dcf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:37 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Volume d4a5336d-f79d-401f-b222-823eecee94ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a5336d-f79d-401f-b222-823eecee94ca', 'volume_size': 1} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1045165215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a5336d-f79d-401f-b222-823eecee94ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b95c1fcafe743fb8306779a1efd61fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:37Z,use_quota=True,user_id='13b2a973aafd447ea84c486368d3fa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Creating volume d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:37:37 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:37:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:37 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca 1073741824 Jul 17 15:37:37 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:38 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca 1073741824" returned: 0 in 0.628s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:38 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca Jul 17 15:37:38 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:38 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca" returned: 0 in 0.294s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:37:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba194201-32b4-4c40-b2cd-c8541d4dcf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a5336d-f79d-401f-b222-823eecee94ca', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01dd71b-5d22-451e-9d04-66dc255d61f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:38 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Volume volume-d4a5336d-f79d-401f-b222-823eecee94ca (d4a5336d-f79d-401f-b222-823eecee94ca): created successfully Jul 17 15:37:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01dd71b-5d22-451e-9d04-66dc255d61f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (85b8c81d-8dee-4ae1-bef6-6912516493cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:38 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fe8ad670-2a3a-482a-8a91-13adef93f0f9 tempest-VolumesSnapshotTestJSON-837647410 None] Created volume successfully. Jul 17 15:37:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Creating offline snapshot e959173f-c27f-4d2b-b466-3ce799eaf24b of volume d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:37:39 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba279fac-a2c1-4953-a322-059d93e59e4c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:40 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca Jul 17 15:37:40 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:40 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca" returned: 0 in 0.535s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:40 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b 1G Jul 17 15:37:40 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:41 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b 1G" returned: 0 in 0.809s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a5336d-f79d-401f-b222-823eecee94ca -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:41 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a5336d-f79d-401f-b222-823eecee94ca -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b Jul 17 15:37:41 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:41 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a5336d-f79d-401f-b222-823eecee94ca -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b" returned: 0 in 0.631s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:41 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b is being set with open permissions: ugo+rw Jul 17 15:37:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:41 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b Jul 17 15:37:41 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:42 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b" returned: 0 in 0.304s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:42 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.info Jul 17 15:37:42 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:42 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.info" returned: 0 in 0.440s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:42 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.info is being set with open permissions: ugo+rw Jul 17 15:37:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:42 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.info Jul 17 15:37:42 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:43 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.info" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.201s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:43 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a07e82fd-cbe7-42ef-9e78-7ec4a9c0c028 tempest-VolumesSnapshotTestJSON-837647410 None] Create snapshot completed successfully Jul 17 15:37:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-38146ce4-42f3-4364-a949-976b82eaae43 tempest-VolumesActionsTest-1617482551 None] Acquiring lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138" by "attach_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-38146ce4-42f3-4364-a949-976b82eaae43 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138" acquired by "attach_volume" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:44 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-38146ce4-42f3-4364-a949-976b82eaae43 tempest-VolumesActionsTest-1617482551 None] Attaching volume 15440c15-5d97-4615-b06b-e7fb29fa1138 to instance e28d056d-fa59-4923-8d92-ad2dcac9ca55 at mountpoint /dev/vdb on host None. Jul 17 15:37:44 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-38146ce4-42f3-4364-a949-976b82eaae43 tempest-VolumesActionsTest-1617482551 None] Attach volume completed successfully. Jul 17 15:37:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-38146ce4-42f3-4364-a949-976b82eaae43 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138" released by "attach_volume" :: held 0.120s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f45477b5-d587-46a3-867f-5d3ca62991d0 tempest-VolumesActionsTest-1617482551 None] Acquiring lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138-detach_volume" by "detach_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f45477b5-d587-46a3-867f-5d3ca62991d0 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:44 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f45477b5-d587-46a3-867f-5d3ca62991d0 tempest-VolumesActionsTest-1617482551 None] Detaching volume 15440c15-5d97-4615-b06b-e7fb29fa1138 from instance e28d056d-fa59-4923-8d92-ad2dcac9ca55. Jul 17 15:37:44 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f45477b5-d587-46a3-867f-5d3ca62991d0 tempest-VolumesActionsTest-1617482551 None] Detach volume completed successfully. Jul 17 15:37:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f45477b5-d587-46a3-867f-5d3ca62991d0 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138-detach_volume" released by "detach_volume" :: held 0.072s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (98c50f4d-8ec5-4598-bb22-445fc17b7bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8601fd9-adcc-4ad5-bc99-382ae02886b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8601fd9-adcc-4ad5-bc99-382ae02886b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1653282453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=103e7b4e-f686-4b58-9e75-24740664822f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b95c1fcafe743fb8306779a1efd61fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e959173f-c27f-4d2b-b466-3ce799eaf24b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:37:45Z,use_quota=True,user_id='13b2a973aafd447ea84c486368d3fa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd50b7d1-e743-4523-b43b-cc97eec36d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd50b7d1-e743-4523-b43b-cc97eec36d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090f173f-ee24-4af0-bcd1-486c934b5665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090f173f-ee24-4af0-bcd1-486c934b5665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '103e7b4e-f686-4b58-9e75-24740664822f', 'volume_name': 'volume-103e7b4e-f686-4b58-9e75-24740664822f', 'volume_size': 1, 'snapshot_id': 'e959173f-c27f-4d2b-b466-3ce799eaf24b'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c144d4-b0bb-41c3-9124-2d88c321be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c144d4-b0bb-41c3-9124-2d88c321be8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d829ad-3c9b-4dc0-951f-fc4416bed7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Volume 103e7b4e-f686-4b58-9e75-24740664822f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-103e7b4e-f686-4b58-9e75-24740664822f', 'volume_size': 1, 'snapshot_id': 'e959173f-c27f-4d2b-b466-3ce799eaf24b'} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-e959173f-c27f-4d2b-b466-3ce799eaf24b-103e7b4e-f686-4b58-9e75-24740664822f" by "_create_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-e959173f-c27f-4d2b-b466-3ce799eaf24b-103e7b4e-f686-4b58-9e75-24740664822f" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Creating volume 103e7b4e-f686-4b58-9e75-24740664822f from snapshot e959173f-c27f-4d2b-b466-3ce799eaf24b {{(pid=87769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-103e7b4e-f686-4b58-9e75-24740664822f" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-103e7b4e-f686-4b58-9e75-24740664822f" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] snapshot: e959173f-c27f-4d2b-b466-3ce799eaf24b, volume: 103e7b4e-f686-4b58-9e75-24740664822f, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[729b99ba-6efc-4e07-870a-b04d9308cb4a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:45 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b Jul 17 15:37:45 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:46 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b" returned: 0 in 0.517s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4a5336d-f79d-401f-b222-823eecee94ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:37:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:37:46 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc858c-ef12-4119-b9da-b9c8629e9930]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:46 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca Jul 17 15:37:46 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:46 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca" returned: 0 in 0.522s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:46 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:37:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:46 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f Jul 17 15:37:46 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:52 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f" returned: 0 in 5.499s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2bfdc1-cb7f-4008-a822-0a89d9f9de14]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:52 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca Jul 17 15:37:52 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:52 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca" returned: 0 in 0.685s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:52 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:37:52 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Converted 1024.00 MB image at 186.16 MB/s Jul 17 15:37:52 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f is being set with open permissions: ugo+rw Jul 17 15:37:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:52 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f Jul 17 15:37:52 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:53 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f" returned: 0 in 0.303s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-103e7b4e-f686-4b58-9e75-24740664822f" released by "_copy_volume_from_snapshot" :: held 7.682s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-e959173f-c27f-4d2b-b466-3ce799eaf24b-103e7b4e-f686-4b58-9e75-24740664822f" released by "_create_volume_from_snapshot" :: held 7.767s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.816s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=164,cinder:INSERT=51,cinder:UPDATE=179,cinder:DELETE=11 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=164,cinder:UPDATE=173,cinder:INSERT=52,cinder:DELETE=20 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d829ad-3c9b-4dc0-951f-fc4416bed7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-103e7b4e-f686-4b58-9e75-24740664822f', 'volume_size': 1, 'snapshot_id': 'e959173f-c27f-4d2b-b466-3ce799eaf24b'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd6638d-ffb5-4058-9f79-7a28ced8b3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:37:53 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Volume volume-103e7b4e-f686-4b58-9e75-24740664822f (103e7b4e-f686-4b58-9e75-24740664822f): created successfully Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd6638d-ffb5-4058-9f79-7a28ced8b3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:37:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Flow 'volume_create_manager' (98c50f4d-8ec5-4598-bb22-445fc17b7bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:37:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-51dbdf10-a060-4d97-9bc2-19d2715ca7bf tempest-VolumesSnapshotTestJSON-837647410 None] Created volume successfully. Jul 17 15:37:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-103e7b4e-f686-4b58-9e75-24740664822f-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-103e7b4e-f686-4b58-9e75-24740664822f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-103e7b4e-f686-4b58-9e75-24740664822f" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-103e7b4e-f686-4b58-9e75-24740664822f" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1aef79-5c89-43bb-a26b-8dfdd770921a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:54 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f Jul 17 15:37:54 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:54 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f" returned: 0 in 0.459s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:54 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f Jul 17 15:37:54 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:55 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-103e7b4e-f686-4b58-9e75-24740664822f" returned: 0 in 0.305s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-103e7b4e-f686-4b58-9e75-24740664822f" released by "delete_volume" :: held 0.811s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Created reservations ['7425f6f0-cd46-4e8e-a662-d09f3915802f', '2eb654e5-6d85-4244-a79f-6dbc361634d1', '1f1c3051-17e6-4755-813f-973553a72c51', '44b1db1b-bbc3-484d-9625-0b242aef6b95'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:55 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:37:55 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-e959173f-c27f-4d2b-b466-3ce799eaf24b-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-e959173f-c27f-4d2b-b466-3ce799eaf24b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-d4a5336d-f79d-401f-b222-823eecee94ca" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-d4a5336d-f79d-401f-b222-823eecee94ca" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-e959173f-c27f-4d2b-b466-3ce799eaf24b" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:55 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-e959173f-c27f-4d2b-b466-3ce799eaf24b" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Deleting offline snapshot e959173f-c27f-4d2b-b466-3ce799eaf24b of volume d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] snapshot_file for this snap is: volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.593s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:37:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Deleted volume successfully. Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7ffa2c-5c56-485b-97aa-80d788de3ae6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e2401767-2fde-4f70-85eb-46cba861c802 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-103e7b4e-f686-4b58-9e75-24740664822f-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:56 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b Jul 17 15:37:56 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:56 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b" returned: 0 in 0.739s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4a5336d-f79d-401f-b222-823eecee94ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8868b-d364-4d5c-a9f9-bbe4955e53df]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:56 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca Jul 17 15:37:56 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:57 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca" returned: 0 in 0.543s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:57 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b Jul 17 15:37:57 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:57 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b" returned: 0 in 0.424s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:57 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b Jul 17 15:37:57 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:58 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca.e959173f-c27f-4d2b-b466-3ce799eaf24b" returned: 0 in 0.279s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-e959173f-c27f-4d2b-b466-3ce799eaf24b" released by "_delete_snapshot" :: held 2.186s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-d4a5336d-f79d-401f-b222-823eecee94ca" released by "delete_snapshot" :: held 2.251s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:58 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Created reservations ['d9fc1f9f-dad0-4ae5-918b-9621d14c5eb8', 'a00df315-0710-4916-838c-38b0b7453310', '0c692fc6-6799-4214-b825-b757b66daf14', 'a594a945-1f54-4a12-bd91-7102e9f91df6'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:37:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Delete snapshot completed successfully. Jul 17 15:37:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d88d17aa-2e52-4650-bbfb-caaf28b36055 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-e959173f-c27f-4d2b-b466-3ce799eaf24b-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fe5c82eb-188e-426d-b72c-288e8c3031e4 tempest-VolumesActionsTest-1617482551 None] Acquiring lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138" by "attach_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fe5c82eb-188e-426d-b72c-288e8c3031e4 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138" acquired by "attach_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fe5c82eb-188e-426d-b72c-288e8c3031e4 tempest-VolumesActionsTest-1617482551 None] Attaching volume 15440c15-5d97-4615-b06b-e7fb29fa1138 to instance ead9dba3-354c-4a91-98b9-1236ebd201b2 at mountpoint /dev/vdb on host None. Jul 17 15:37:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fe5c82eb-188e-426d-b72c-288e8c3031e4 tempest-VolumesActionsTest-1617482551 None] Attach volume completed successfully. Jul 17 15:37:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fe5c82eb-188e-426d-b72c-288e8c3031e4 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138" released by "attach_volume" :: held 0.118s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-abc4fdbc-21e4-4001-8864-dd717568702f tempest-VolumesActionsTest-1617482551 None] Acquiring lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138-detach_volume" by "detach_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-abc4fdbc-21e4-4001-8864-dd717568702f tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-abc4fdbc-21e4-4001-8864-dd717568702f tempest-VolumesActionsTest-1617482551 None] Detaching volume 15440c15-5d97-4615-b06b-e7fb29fa1138 from instance ead9dba3-354c-4a91-98b9-1236ebd201b2. Jul 17 15:37:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-abc4fdbc-21e4-4001-8864-dd717568702f tempest-VolumesActionsTest-1617482551 None] Detach volume completed successfully. Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-abc4fdbc-21e4-4001-8864-dd717568702f tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-d4a5336d-f79d-401f-b222-823eecee94ca-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-d4a5336d-f79d-401f-b222-823eecee94ca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-d4a5336d-f79d-401f-b222-823eecee94ca" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-d4a5336d-f79d-401f-b222-823eecee94ca" acquired by "delete_volume" :: waited 0.034s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9a8b3-a436-4af8-bed1-ad579063f027]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:37:59 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca Jul 17 15:37:59 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:37:59 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca" returned: 0 in 0.549s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:37:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:00 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca Jul 17 15:38:00 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:00 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d4a5336d-f79d-401f-b222-823eecee94ca" returned: 0 in 0.365s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-d4a5336d-f79d-401f-b222-823eecee94ca" released by "delete_volume" :: held 1.008s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Created reservations ['d18c9473-50ca-4bf1-8367-2785fbb52e0c', '14c48e8e-e401-46cc-9250-2e04a9dcd5cc', '54b8da69-5a7b-48a4-845a-150995112327', 'd8954d21-62c7-4310-8ad3-167715780602'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:00 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:38:00 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:00 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.306s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:38:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Deleted volume successfully. Jul 17 15:38:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93ea3806-aa56-4c21-b77f-176f1caac307 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-d4a5336d-f79d-401f-b222-823eecee94ca-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "cinder-quobyte-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afe6af6-3853-44eb-9523-c1146e24272d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:01 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 Jul 17 15:38:01 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:02 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" returned: 0 in 0.384s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:02 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433 Jul 17 15:38:02 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:02 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" returned: 0 in 0.291s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-quobyte-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433" released by "delete_volume" :: held 0.761s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Created reservations ['ac96a6eb-f88b-4080-a9fd-854fe69b550a', '2747b5ab-553f-426e-97a2-d581b701ad1e', 'e59a9b12-51a4-4b20-8553-9e8f1c4f41b1', '2f5b311f-e82e-4f8c-a42d-3c2e50c9ea64'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:02 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:38:02 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:02 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.410s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:03 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:38:03 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Deleted volume successfully. Jul 17 15:38:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9b33f8dd-0a7b-4dae-977d-4065b6317b10 tempest-VolumesSnapshotTestJSON-837647410 None] Lock "cinder-1724ff5b-8ada-4fa5-93a8-5d6af8d8d433-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:04 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[46738750-6eec-422e-9a43-52a803d7eacf]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:04 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 Jul 17 15:38:04 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:04 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138" returned: 0 in 0.429s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:04 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[79baba99-6f88-4cf3-9fa6-584095ff7cac]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:04 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 Jul 17 15:38:04 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:04 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138" returned: 0 in 0.409s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.2d472b72-c26b-4339-8547-79238901fb1cuwmjyd1k.img {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:04 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.2d472b72-c26b-4339-8547-79238901fb1cuwmjyd1k.img Jul 17 15:38:04 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Flow 'volume_create_manager' (e045ffcf-2b86-4a3f-b0b3-abd008ded180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bf8b65-780e-4acd-a86d-8cca177afefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bf8b65-780e-4acd-a86d-8cca177afefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-269561597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1640ae5-d3c1-421c-b805-d7fb1b116a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e11918843a2450e9931602f1247a7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:06Z,use_quota=True,user_id='9f3cafa2436d4179a1e007eb6eb59ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5123e3-8fe0-406a-bc04-18830d7a26dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5123e3-8fe0-406a-bc04-18830d7a26dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7707484f-48e5-4283-b9ea-f3d8d7816407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7707484f-48e5-4283-b9ea-f3d8d7816407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1640ae5-d3c1-421c-b805-d7fb1b116a11', 'volume_name': 'volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a522a8-d16b-4204-be4e-60d74d464071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a522a8-d16b-4204-be4e-60d74d464071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de30698-2d53-4688-9241-e303555ac102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:06 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Volume b1640ae5-d3c1-421c-b805-d7fb1b116a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11', 'volume_size': 1} Jul 17 15:38:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:10 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.2d472b72-c26b-4339-8547-79238901fb1cuwmjyd1k.img" returned: 0 in 5.105s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[188168fa-d7b2-4907-a0fe-27cc93aa6c01]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:10 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 Jul 17 15:38:10 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:10 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138" returned: 0 in 0.551s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:10 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.2d472b72-c26b-4339-8547-79238901fb1cuwmjyd1k.img {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:38:10 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Converted 1024.00 MB image at 200.56 MB/s Jul 17 15:38:10 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] 2d472b72-c26b-4339-8547-79238901fb1c was raw, no need to convert to raw {{(pid=87769) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 17 15:38:11 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Flow 'volume_create_manager' (aa607237-7778-4f0e-92af-b27905bff7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbf31e0-8d1a-4ed8-bb1f-40c9aaa6ded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbf31e0-8d1a-4ed8-bb1f-40c9aaa6ded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-892165512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b3e3a8-ad08-4a8e-86b3-795b701881be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea553894b974d349e924d348957c29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:12Z,use_quota=True,user_id='261fed8c2ae2477b825815f869577e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ee741d-1bb6-4de6-b8f4-1ee5e2873894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ee741d-1bb6-4de6-b8f4-1ee5e2873894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94843133-d43e-4a87-b416-28e90fed5452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94843133-d43e-4a87-b416-28e90fed5452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b3e3a8-ad08-4a8e-86b3-795b701881be', 'volume_name': 'volume-17b3e3a8-ad08-4a8e-86b3-795b701881be', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4210eda-3405-40fe-bd0a-b971a9678525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4210eda-3405-40fe-bd0a-b971a9678525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26714371-9045-4fcb-9207-29f8782dd677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:12 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Volume 17b3e3a8-ad08-4a8e-86b3-795b701881be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b3e3a8-ad08-4a8e-86b3-795b701881be', 'volume_size': 1} Jul 17 15:38:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:38:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:22 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:38:22 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:23 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.384s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:38:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:38:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:38:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:38:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=36,cinder:SELECT=32,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:38:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:DELETE=1,cinder:SELECT=30,cinder:INSERT=8,cinder:UPDATE=34 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.307s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Uploaded volume to glance image-id: 2d472b72-c26b-4339-8547-79238901fb1c. {{(pid=87769) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.605s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-269561597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1640ae5-d3c1-421c-b805-d7fb1b116a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e11918843a2450e9931602f1247a7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:06Z,use_quota=True,user_id='9f3cafa2436d4179a1e007eb6eb59ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Creating volume b1640ae5-d3c1-421c-b805-d7fb1b116a11 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:38:29 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:29 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 1073741824 Jul 17 15:38:29 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:29 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-47a01d1e-ccd7-40d2-9533-fe9f1ca41c6f tempest-VolumesActionsTest-1617482551 None] Copy volume to image completed successfully. Jul 17 15:38:29 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 1073741824" returned: 0 in 0.426s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:29 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 Jul 17 15:38:29 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:30 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11" returned: 0 in 0.241s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-892165512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b3e3a8-ad08-4a8e-86b3-795b701881be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea553894b974d349e924d348957c29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:12Z,use_quota=True,user_id='261fed8c2ae2477b825815f869577e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Creating volume 17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:38:30 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de30698-2d53-4688-9241-e303555ac102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:30 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be 1073741824 Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214a4963-40d2-4a59-aae0-866ff0d2db8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:30 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:30 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Volume volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 (b1640ae5-d3c1-421c-b805-d7fb1b116a11): created successfully Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214a4963-40d2-4a59-aae0-866ff0d2db8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Flow 'volume_create_manager' (e045ffcf-2b86-4a3f-b0b3-abd008ded180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:30 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-99d91fe3-2c53-43e5-8e0e-99e1f174fd30 tempest-AbsoluteLimitsTests-426114537 None] Created volume successfully. Jul 17 15:38:30 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be 1073741824" returned: 0 in 0.441s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:30 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be Jul 17 15:38:30 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:30 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26714371-9045-4fcb-9207-29f8782dd677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b3e3a8-ad08-4a8e-86b3-795b701881be', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acb0cff-65ca-4206-aaa7-4fe8adca89ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:30 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Volume volume-17b3e3a8-ad08-4a8e-86b3-795b701881be (17b3e3a8-ad08-4a8e-86b3-795b701881be): created successfully Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acb0cff-65ca-4206-aaa7-4fe8adca89ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:30 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Flow 'volume_create_manager' (aa607237-7778-4f0e-92af-b27905bff7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:30 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-af5b7bb2-5799-4867-ab40-887eb94a3834 tempest-VolumesSnapshotListTestJSON-1488075714 None] Created volume successfully. Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Acquiring lock "cinder-b1640ae5-d3c1-421c-b805-d7fb1b116a11-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Lock "cinder-b1640ae5-d3c1-421c-b805-d7fb1b116a11-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Acquiring lock "cinder-quobyte-b1640ae5-d3c1-421c-b805-d7fb1b116a11" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Lock "cinder-quobyte-b1640ae5-d3c1-421c-b805-d7fb1b116a11" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9172ed5-afae-40fe-a45a-3050126fa607]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eada21-82cb-4dc9-b5e0-d84a1fbe9734]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:31 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 Jul 17 15:38:31 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:31 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 Jul 17 15:38:31 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:31 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11" returned: 0 in 0.412s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:31 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11 Jul 17 15:38:31 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:31 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138" returned: 0 in 0.431s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[487a03b5-b1a6-40e3-a706-9c3e953bec8f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:31 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 Jul 17 15:38:31 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:31 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b1640ae5-d3c1-421c-b805-d7fb1b116a11" returned: 0 in 0.261s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Lock "cinder-quobyte-b1640ae5-d3c1-421c-b805-d7fb1b116a11" released by "delete_volume" :: held 0.729s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:31 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Created reservations ['f571bb45-c218-4e75-bf87-81b215a4986f', '5224082b-19f6-49fb-aa73-bd2843acd9b5', 'bf4fc09a-3369-441d-b993-fa5c6a283abc', '86e77852-55e6-4674-b2e8-6d308ffec887'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:32 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:38:32 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:32 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138" returned: 0 in 0.383s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:32 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img Jul 17 15:38:32 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:32 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.249s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:38:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Deleted volume successfully. Jul 17 15:38:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efa7d752-7446-4443-a52d-a231366ec346 tempest-AbsoluteLimitsTests-426114537 None] Lock "cinder-b1640ae5-d3c1-421c-b805-d7fb1b116a11-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:36 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img" returned: 0 in 4.805s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:36 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e88543c-6887-4b28-b48c-3d3c8e157a0a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:37 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 Jul 17 15:38:37 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:37 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138" returned: 0 in 0.548s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:37 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138, size 1024.00 MB, duration 4.81 sec, destination /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:38:37 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Converted 1024.00 MB image at 213.06 MB/s Jul 17 15:38:37 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] 964ec838-3d50-45e0-ad4a-f6e6586e0df0 was raw, converting to qcow2 {{(pid=87769) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 17 15:38:37 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[08693809-5760-4c30-99dd-9f16c212dc4a]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:37 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img Jul 17 15:38:37 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:37 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img" returned: 0 in 0.341s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:37 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img Jul 17 15:38:37 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:38 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img" returned: 1 in 0.355s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:38:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img /opt/stack/data/cinder/conversion/vol_upload_dw1jlv6t {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:38 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img /opt/stack/data/cinder/conversion/vol_upload_dw1jlv6t Jul 17 15:38:38 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:38 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img /opt/stack/data/cinder/conversion/vol_upload_dw1jlv6t" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:38 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Image conversion details: src /opt/stack/data/cinder/conversion/15440c15-5d97-4615-b06b-e7fb29fa1138.temp_image.964ec838-3d50-45e0-ad4a-f6e6586e0df0ztd7vk40.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dw1jlv6t {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:38:38 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 17 15:38:38 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d6f78d-a184-406d-acbf-0d4cc7b597bb]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dw1jlv6t {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:38 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dw1jlv6t Jul 17 15:38:38 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:38 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dw1jlv6t" returned: 0 in 0.349s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Flow 'volume_create_manager' (c25c52c6-a450-4ff4-b7ee-943d3194a8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1386a56-69e3-4051-b863-b8a1a6df71a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1386a56-69e3-4051-b863-b8a1a6df71a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1555999161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809b9944-aad8-479f-a0ad-9be42c8f2aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd3e26e041a4aca9c652e0c62188da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:39Z,use_quota=True,user_id='b47be11eede6488aafb69917d403c837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403d9dc6-1a44-4eb9-bde3-9f2ca9cc8fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403d9dc6-1a44-4eb9-bde3-9f2ca9cc8fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc823130-4a3a-45dd-8411-00e0a0993ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.image.glance [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Creating Keystone auth plugin from conf {{(pid=87769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc823130-4a3a-45dd-8411-00e0a0993ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '809b9944-aad8-479f-a0ad-9be42c8f2aca', 'volume_name': 'volume-809b9944-aad8-479f-a0ad-9be42c8f2aca', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe03b46-c0f4-4bf6-bef9-3d743f83b7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe03b46-c0f4-4bf6-bef9-3d743f83b7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72729f55-a6f0-4f02-8daf-1f21885f3f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:39 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Volume 809b9944-aad8-479f-a0ad-9be42c8f2aca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-809b9944-aad8-479f-a0ad-9be42c8f2aca', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Trying to clone 809b9944-aad8-479f-a0ad-9be42c8f2aca from image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]). {{(pid=87769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 15:38:39 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Image download 20.69 MB at 20.69 MB/s Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2fb5ee-d77c-4f38-a39f-2cef4736ad98]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:39 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD Jul 17 15:38:39 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:40 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Temporary image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 is fetched for user b47be11eede6488aafb69917d403c837. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9a1f94-a8a4-44ea-985d-784c97ab36aa]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:40 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD Jul 17 15:38:40 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Uploaded volume to glance image-id: 964ec838-3d50-45e0-ad4a-f6e6586e0df0. {{(pid=87769) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.841s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Creating offline snapshot 881b987b-498e-419b-a6bf-ce1c6239df4e of volume 17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:38:40 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fea58806-1232-4a5b-b3d4-588e0261df18 tempest-VolumesActionsTest-1617482551 None] Copy volume to image completed successfully. Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3116a1ad-2f49-4c74-9f4b-c0a873028772]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:40 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be Jul 17 15:38:40 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:40 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:40 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be" returned: 0 in 0.374s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:40 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e 1G Jul 17 15:38:40 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:41 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e 1G" returned: 0 in 0.442s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b3e3a8-ad08-4a8e-86b3-795b701881be -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:41 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b3e3a8-ad08-4a8e-86b3-795b701881be -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e Jul 17 15:38:41 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Acquiring lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:41 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b3e3a8-ad08-4a8e-86b3-795b701881be -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e" returned: 0 in 0.317s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:41 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e is being set with open permissions: ugo+rw Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Acquiring lock "cinder-quobyte-15440c15-5d97-4615-b06b-e7fb29fa1138" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:41 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e Jul 17 15:38:41 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-quobyte-15440c15-5d97-4615-b06b-e7fb29fa1138" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb80bdb3-39d1-4c20-a5b0-32ff69e88499]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:41 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 Jul 17 15:38:41 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:41 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e" returned: 0 in 0.253s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:41 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.info Jul 17 15:38:41 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:41 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138" returned: 0 in 0.391s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:41 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138 Jul 17 15:38:41 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:41 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.info" returned: 0 in 0.269s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:41 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.info is being set with open permissions: ugo+rw Jul 17 15:38:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:42 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.info Jul 17 15:38:42 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:42 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-15440c15-5d97-4615-b06b-e7fb29fa1138" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-quobyte-15440c15-5d97-4615-b06b-e7fb29fa1138" released by "delete_volume" :: held 0.692s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Created reservations ['21a133a1-2956-4534-872e-f2dd2fa81561', '03a803cd-9b20-4fd4-a7c2-bd3a0fc7c27b', '354bafed-9dbd-487a-8ee5-d953280a3783', '5bb448d4-4b76-4d40-8ba9-75a303038433'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:42 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.info" returned: 0 in 0.265s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.814s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1555999161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809b9944-aad8-479f-a0ad-9be42c8f2aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd3e26e041a4aca9c652e0c62188da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:39Z,use_quota=True,user_id='b47be11eede6488aafb69917d403c837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Creating volume 809b9944-aad8-479f-a0ad-9be42c8f2aca {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:38:42 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:42 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca 1073741824 Jul 17 15:38:42 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2c320b86-302e-48bc-b9d8-c35dc5bc99fc tempest-VolumesSnapshotListTestJSON-1488075714 None] Create snapshot completed successfully Jul 17 15:38:42 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:38:42 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:42 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.271s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:38:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Deleted volume successfully. Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ddf87bc-dedc-423a-9c8d-a92282d1d802 tempest-VolumesActionsTest-1617482551 None] Lock "cinder-15440c15-5d97-4615-b06b-e7fb29fa1138-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:42 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca 1073741824" returned: 0 in 0.493s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:42 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca Jul 17 15:38:42 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:43 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca" returned: 0 in 0.291s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Attempting download of 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 ((None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}])) to volume 809b9944-aad8-479f-a0ad-9be42c8f2aca. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6327d046-1e39-45b0-9a89-cf4f034c0731]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_11t0q1k8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Creating offline snapshot cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 of volume 17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:38:43 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_11t0q1k8 Jul 17 15:38:43 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[954242df-bc4f-4ebf-9c0b-72dd5fc7bf7f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:43 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e Jul 17 15:38:43 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:43 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_11t0q1k8" returned: 0 in 0.384s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_11t0q1k8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:43 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_11t0q1k8 Jul 17 15:38:43 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:43 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e" returned: 0 in 0.447s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b3e3a8-ad08-4a8e-86b3-795b701881be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:38:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:43 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 1G Jul 17 15:38:43 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:44 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_11t0q1k8" returned: 1 in 0.454s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_11t0q1k8' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a978ad5e-0f20-4d88-af90-52161a96d50e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:44 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD Jul 17 15:38:44 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:44 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 1G" returned: 0 in 0.572s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:44 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 was qcow2, converting to qcow2 {{(pid=87769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 15:38:44 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:44 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:44 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca Jul 17 15:38:44 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:44 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" returned: 0 in 0.331s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:44 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 is being set with open permissions: ugo+rw Jul 17 15:38:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:44 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 Jul 17 15:38:44 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:45 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" returned: 0 in 0.282s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.759s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-bb88ec67-f0ba-4176-962d-107bb6408886 tempest-VolumesSnapshotListTestJSON-1488075714 None] Create snapshot completed successfully Jul 17 15:38:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Creating offline snapshot e6e8ba3e-0377-4836-9ee1-dae1c016900f of volume 17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:38:45 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf76ac46-dc3a-4209-98b9-97e72e69787b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:45 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 Jul 17 15:38:45 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:46 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" returned: 0 in 0.420s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b3e3a8-ad08-4a8e-86b3-795b701881be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:46 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f 1G Jul 17 15:38:46 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:46 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca" returned: 0 in 2.041s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_whp_qmaidevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:38:46 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Converted 112.00 MB image at 54.84 MB/s Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:46 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca 1G Jul 17 15:38:46 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:46 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f 1G" returned: 0 in 0.607s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:46 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f Jul 17 15:38:46 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:46 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca 1G" returned: 0 in 0.479s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Downloaded image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 ((None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}])) to volume 809b9944-aad8-479f-a0ad-9be42c8f2aca successfully. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Temporary image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 for user b47be11eede6488aafb69917d403c837 is deleted. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Marking volume 809b9944-aad8-479f-a0ad-9be42c8f2aca as bootable. {{(pid=87769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Copying metadata from image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 to 809b9944-aad8-479f-a0ad-9be42c8f2aca. {{(pid=87769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 15:38:46 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Creating volume glance metadata for volume 809b9944-aad8-479f-a0ad-9be42c8f2aca backed by image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72729f55-a6f0-4f02-8daf-1f21885f3f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809b9944-aad8-479f-a0ad-9be42c8f2aca', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ef996e-1e3e-4358-80de-dbc687c03a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:47 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Volume volume-809b9944-aad8-479f-a0ad-9be42c8f2aca (809b9944-aad8-479f-a0ad-9be42c8f2aca): created successfully Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ef996e-1e3e-4358-80de-dbc687c03a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Flow 'volume_create_manager' (c25c52c6-a450-4ff4-b7ee-943d3194a8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:47 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0fbcb8aa-6f2e-409c-bf10-d72198770d83 tempest-VolumesExtendTest-665103250 None] Created volume successfully. Jul 17 15:38:47 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f" returned: 0 in 0.349s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:47 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f is being set with open permissions: ugo+rw Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:47 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f Jul 17 15:38:47 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:47 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f" returned: 0 in 0.265s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.802s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:47 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-21f19c33-1a93-4687-b7bb-6828ba3db2c2 tempest-VolumesSnapshotListTestJSON-1488075714 None] Create snapshot completed successfully Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ce6472b3-ed08-42fd-b6e4-223b8a9e7e9c tempest-VolumesExtendTest-665103250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ce6472b3-ed08-42fd-b6e4-223b8a9e7e9c tempest-VolumesExtendTest-665103250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[29088410-c9a2-4578-b3b9-24ead6a5fa1a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce6472b3-ed08-42fd-b6e4-223b8a9e7e9c tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:47 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca Jul 17 15:38:47 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:48 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce6472b3-ed08-42fd-b6e4-223b8a9e7e9c tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca" returned: 0 in 0.450s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce6472b3-ed08-42fd-b6e4-223b8a9e7e9c tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca 2G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce6472b3-ed08-42fd-b6e4-223b8a9e7e9c tempest-VolumesExtendTest-665103250 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca 2G" returned: 0 in 0.123s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ce6472b3-ed08-42fd-b6e4-223b8a9e7e9c tempest-VolumesExtendTest-665103250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.617s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ce6472b3-ed08-42fd-b6e4-223b8a9e7e9c tempest-VolumesExtendTest-665103250 None] Extend volume completed successfully. Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-e6e8ba3e-0377-4836-9ee1-dae1c016900f-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-e6e8ba3e-0377-4836-9ee1-dae1c016900f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-quobyte-e6e8ba3e-0377-4836-9ee1-dae1c016900f" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-e6e8ba3e-0377-4836-9ee1-dae1c016900f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Deleting offline snapshot e6e8ba3e-0377-4836-9ee1-dae1c016900f of volume 17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] snapshot_file for this snap is: volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[86272bc4-06bf-4630-b1cd-8d0ae21b8bee]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:48 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f Jul 17 15:38:48 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Acquiring lock "cinder-809b9944-aad8-479f-a0ad-9be42c8f2aca-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Lock "cinder-809b9944-aad8-479f-a0ad-9be42c8f2aca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Acquiring lock "cinder-quobyte-809b9944-aad8-479f-a0ad-9be42c8f2aca" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Lock "cinder-quobyte-809b9944-aad8-479f-a0ad-9be42c8f2aca" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:49 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f" returned: 0 in 0.451s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b3e3a8-ad08-4a8e-86b3-795b701881be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbac861-d85c-4a7a-86a2-48abb254849e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7574ba-598b-4682-b024-6f62f8b88932]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:49 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca Jul 17 15:38:49 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:49 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 Jul 17 15:38:49 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Flow 'volume_create_manager' (100f66b9-262e-4dd1-b16e-5e04b9b0ed6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6154b985-9e5d-407a-ba29-6619266c06ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6154b985-9e5d-407a-ba29-6619266c06ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1061380944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7b4acd-209f-43da-9969-9ed455dd560b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b1033fe7264d9182b1c7631e1b0d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:50Z,use_quota=True,user_id='6eeea982a09b43b2bc4a14dec3cec9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e991eca-77dd-4233-97a0-3e2431906129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e991eca-77dd-4233-97a0-3e2431906129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e30aae-0e9d-4423-9b54-3743d5c9f342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e30aae-0e9d-4423-9b54-3743d5c9f342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7b4acd-209f-43da-9969-9ed455dd560b', 'volume_name': 'volume-8a7b4acd-209f-43da-9969-9ed455dd560b', 'volume_size': 2}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb5b7f7-3bd0-41e0-8b64-06a18098acc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb5b7f7-3bd0-41e0-8b64-06a18098acc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc18dc3-fcd6-41b1-aa78-4ecc0a9b4d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:49 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Volume 8a7b4acd-209f-43da-9969-9ed455dd560b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7b4acd-209f-43da-9969-9ed455dd560b', 'volume_size': 2} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1061380944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7b4acd-209f-43da-9969-9ed455dd560b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b1033fe7264d9182b1c7631e1b0d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:50Z,use_quota=True,user_id='6eeea982a09b43b2bc4a14dec3cec9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Creating volume 8a7b4acd-209f-43da-9969-9ed455dd560b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:49 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:38:49 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:49 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b 2147483648 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" returned: 0 in 0.429s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca" returned: 0 in 0.444s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b3e3a8-ad08-4a8e-86b3-795b701881be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:49 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b 2147483648 Jul 17 15:38:49 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:49 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f Jul 17 15:38:49 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:49 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca Jul 17 15:38:49 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:49 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-809b9944-aad8-479f-a0ad-9be42c8f2aca" returned: 0 in 0.267s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Lock "cinder-quobyte-809b9944-aad8-479f-a0ad-9be42c8f2aca" released by "delete_volume" :: held 0.776s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Created reservations ['495f7844-c121-4bde-ac73-920221ef9e9c', '4fe9d795-640f-4939-8e6e-51a99875dd33', '0c1f318f-ba9c-4746-ab15-ee26ceda1e36', '1eb49cc5-06f1-4288-890c-6b14fbfb9188'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:50 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f" returned: 0 in 0.456s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:50 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:38:50 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:50 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f Jul 17 15:38:50 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:50 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b 2147483648" returned: 0 in 0.534s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:50 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b Jul 17 15:38:50 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:50 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.283s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:38:50 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Deleted volume successfully. Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db6db5f9-c572-4a8a-8af3-f979ef69b378 tempest-VolumesExtendTest-665103250 None] Lock "cinder-809b9944-aad8-479f-a0ad-9be42c8f2aca-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:50 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.e6e8ba3e-0377-4836-9ee1-dae1c016900f" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-e6e8ba3e-0377-4836-9ee1-dae1c016900f" released by "_delete_snapshot" :: held 1.776s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" released by "delete_snapshot" :: held 1.804s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:50 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b" returned: 0 in 0.298s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc18dc3-fcd6-41b1-aa78-4ecc0a9b4d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7b4acd-209f-43da-9969-9ed455dd560b', 'volume_size': 2}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ba0789-298c-4bb5-aae6-058c0dc6791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Volume volume-8a7b4acd-209f-43da-9969-9ed455dd560b (8a7b4acd-209f-43da-9969-9ed455dd560b): created successfully Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ba0789-298c-4bb5-aae6-058c0dc6791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Flow 'volume_create_manager' (100f66b9-262e-4dd1-b16e-5e04b9b0ed6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:50 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c572e69d-522c-452c-986b-70b4eba6a872 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Created volume successfully. Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Created reservations ['e21e4ae2-1d0d-4bf2-9c64-22c7815caa4a', '7527aefb-3d10-4664-b00c-f3c8a8ffac7e', '3162fb46-fe46-4a67-b752-ff46a3cf245b', 'f18df5b2-6303-41ff-96fc-baeea4dd728f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:50 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Delete snapshot completed successfully. Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea4e6bc3-fd91-48c4-94ab-5e49ce14be4e tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-e6e8ba3e-0377-4836-9ee1-dae1c016900f-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Flow 'volume_create_manager' (58bce243-a5e6-45b5-bf87-7f6a45fcd0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736d3062-7478-4ed0-9c31-70691262e8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736d3062-7478-4ed0-9c31-70691262e8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2007415386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4339473e-71f1-464f-9bb9-1b473ea81f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd3e26e041a4aca9c652e0c62188da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:51Z,use_quota=True,user_id='b47be11eede6488aafb69917d403c837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89ae9b7-1a0f-4ea1-8283-d5689384d5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89ae9b7-1a0f-4ea1-8283-d5689384d5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e624f85d-4aaf-461d-a830-499e7c501f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e624f85d-4aaf-461d-a830-499e7c501f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4339473e-71f1-464f-9bb9-1b473ea81f5e', 'volume_name': 'volume-4339473e-71f1-464f-9bb9-1b473ea81f5e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b6bfd1-0665-4289-8f2d-79acce13f6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b6bfd1-0665-4289-8f2d-79acce13f6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afdd3a6-924f-44f0-be85-12b6b5d8ed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Volume 4339473e-71f1-464f-9bb9-1b473ea81f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4339473e-71f1-464f-9bb9-1b473ea81f5e', 'volume_size': 1} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2007415386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4339473e-71f1-464f-9bb9-1b473ea81f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd3e26e041a4aca9c652e0c62188da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:38:51Z,use_quota=True,user_id='b47be11eede6488aafb69917d403c837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Creating volume 4339473e-71f1-464f-9bb9-1b473ea81f5e {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:38:50 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:50 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e 1073741824 Jul 17 15:38:50 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-quobyte-cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Deleting offline snapshot cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 of volume 17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] snapshot_file for this snap is: volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c788103-d0a9-4614-96e5-f5ded64057d0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:51 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 Jul 17 15:38:51 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:51 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e 1073741824" returned: 0 in 0.451s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:51 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" returned: 0 in 0.404s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b3e3a8-ad08-4a8e-86b3-795b701881be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:38:51 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e Jul 17 15:38:51 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[24239eae-2b61-4dd6-bfc7-5117fdc7a723]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:51 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e Jul 17 15:38:51 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:51 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e" returned: 0 in 0.268s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afdd3a6-924f-44f0-be85-12b6b5d8ed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4339473e-71f1-464f-9bb9-1b473ea81f5e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5eaa94b-e1c9-4d05-9049-d1bd171a4bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:38:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Volume volume-4339473e-71f1-464f-9bb9-1b473ea81f5e (4339473e-71f1-464f-9bb9-1b473ea81f5e): created successfully Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5eaa94b-e1c9-4d05-9049-d1bd171a4bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Flow 'volume_create_manager' (58bce243-a5e6-45b5-bf87-7f6a45fcd0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:38:51 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-30790d88-6c4c-4993-88f4-60fd918fbe58 tempest-VolumesExtendTest-665103250 None] Created volume successfully. Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Creating offline snapshot 11099872-bbd7-4695-bcc0-c0b43cc420dd of volume 8a7b4acd-209f-43da-9969-9ed455dd560b {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:38:51 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d7de5-f28e-48f3-bbf5-c3d8d1feef6f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e" returned: 0 in 0.436s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b3e3a8-ad08-4a8e-86b3-795b701881be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:38:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:51 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 Jul 17 15:38:51 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:52 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b Jul 17 15:38:52 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:52 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b" returned: 0 in 0.371s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd 2G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:52 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" returned: 0 in 0.378s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:52 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd 2G Jul 17 15:38:52 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:52 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094 Jul 17 15:38:52 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:52 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" returned: 0 in 0.250s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094" released by "_delete_snapshot" :: held 1.567s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" released by "delete_snapshot" :: held 1.589s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Created reservations ['8df0ac6d-e52b-4946-be2c-e5fd1b2d190c', '879e9443-0242-4a79-b90c-fb79745bebe1', '603df356-a933-4c10-b59e-1e57d1dfbb76', '1bd18bbc-ca1d-4560-84fb-07838ae7a85a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:52 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd 2G" returned: 0 in 0.415s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a7b4acd-209f-43da-9969-9ed455dd560b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Delete snapshot completed successfully. Jul 17 15:38:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6e247a2e-f314-4c10-a02b-59abaa02603f tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-cd7f8e5a-76ae-4805-a2ce-7a5fbaac9094-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:52 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a7b4acd-209f-43da-9969-9ed455dd560b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd Jul 17 15:38:52 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:52 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a7b4acd-209f-43da-9969-9ed455dd560b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd" returned: 0 in 0.321s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:53 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd is being set with open permissions: ugo+rw Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-881b987b-498e-419b-a6bf-ce1c6239df4e-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:53 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd Jul 17 15:38:53 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-881b987b-498e-419b-a6bf-ce1c6239df4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-quobyte-881b987b-498e-419b-a6bf-ce1c6239df4e" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-881b987b-498e-419b-a6bf-ce1c6239df4e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Deleting offline snapshot 881b987b-498e-419b-a6bf-ce1c6239df4e of volume 17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] snapshot_file for this snap is: volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6469d124-b6d8-45df-8d82-e35ca29fc72f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:53 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e Jul 17 15:38:53 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:53 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd" returned: 0 in 0.284s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:53 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.info Jul 17 15:38:53 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:53 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e" returned: 0 in 0.389s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b3e3a8-ad08-4a8e-86b3-795b701881be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a499382-6d24-4e4e-a156-c2c7b218c93e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:53 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.info" returned: 0 in 0.260s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:53 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.info is being set with open permissions: ugo+rw Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:53 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.info Jul 17 15:38:53 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:53 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be Jul 17 15:38:53 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:53 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.info" returned: 0 in 0.256s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.717s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Creating offline snapshot 81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b of volume 4339473e-71f1-464f-9bb9-1b473ea81f5e {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[08298acd-d042-4852-8337-9119922afdf6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2b30a603-6865-4ab7-8e26-762eb98a055b tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Create snapshot completed successfully Jul 17 15:38:53 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be" returned: 0 in 0.393s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:53 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e Jul 17 15:38:53 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:54 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e Jul 17 15:38:54 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:54 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e" returned: 0 in 0.380s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:54 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e" returned: 0 in 0.332s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:54 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b 1G Jul 17 15:38:54 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:54 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e Jul 17 15:38:54 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:54 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be.881b987b-498e-419b-a6bf-ce1c6239df4e" returned: 0 in 0.248s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-881b987b-498e-419b-a6bf-ce1c6239df4e" released by "_delete_snapshot" :: held 1.471s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" released by "delete_snapshot" :: held 1.505s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Created reservations ['23f3b463-35b4-47e7-821c-b0d6738280f5', '542a94b8-7483-4583-b254-60731b42a8c9', 'e62909d4-0777-4258-9ee0-75ff3ea11b03', '93b5d609-9c75-474a-b55a-40583e399122'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:54 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b 1G" returned: 0 in 0.413s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4339473e-71f1-464f-9bb9-1b473ea81f5e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:54 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4339473e-71f1-464f-9bb9-1b473ea81f5e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b Jul 17 15:38:54 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Delete snapshot completed successfully. Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-db8f3e6c-2ce6-4259-9aa1-494603435a56 tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-881b987b-498e-419b-a6bf-ce1c6239df4e-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:54 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4339473e-71f1-464f-9bb9-1b473ea81f5e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b" returned: 0 in 0.297s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:54 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b is being set with open permissions: ugo+rw Jul 17 15:38:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:55 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b Jul 17 15:38:55 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Acquiring lock "cinder-11099872-bbd7-4695-bcc0-c0b43cc420dd-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-11099872-bbd7-4695-bcc0-c0b43cc420dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Acquiring lock "cinder-quobyte-8a7b4acd-209f-43da-9969-9ed455dd560b" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-quobyte-8a7b4acd-209f-43da-9969-9ed455dd560b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Acquiring lock "cinder-quobyte-11099872-bbd7-4695-bcc0-c0b43cc420dd" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-quobyte-11099872-bbd7-4695-bcc0-c0b43cc420dd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Deleting offline snapshot 11099872-bbd7-4695-bcc0-c0b43cc420dd of volume 8a7b4acd-209f-43da-9969-9ed455dd560b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] snapshot_file for this snap is: volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e405d0-5db4-4967-80d1-1541127e7ec1]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:55 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b" returned: 0 in 0.257s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-17b3e3a8-ad08-4a8e-86b3-795b701881be-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:55 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd Jul 17 15:38:55 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:55 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.info Jul 17 15:38:55 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-17b3e3a8-ad08-4a8e-86b3-795b701881be-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a8b2a8-e710-4269-be79-bc089d179270]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:55 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.info" returned: 0 in 0.264s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:55 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.info is being set with open permissions: ugo+rw Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:55 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be Jul 17 15:38:55 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:55 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd" returned: 0 in 0.394s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a7b4acd-209f-43da-9969-9ed455dd560b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:38:55 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.info Jul 17 15:38:55 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[17362e68-9738-4ba4-be3e-6605a8f9e29b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:55 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b Jul 17 15:38:55 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:55 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:55 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.info" returned: 0 in 0.264s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be" returned: 0 in 0.411s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:55 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be Jul 17 15:38:55 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-aa83afa5-5be2-431d-93c4-f7767b5678b9 tempest-VolumesExtendTest-665103250 None] Create snapshot completed successfully Jul 17 15:38:56 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b" returned: 0 in 0.399s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:56 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd Jul 17 15:38:56 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:56 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-17b3e3a8-ad08-4a8e-86b3-795b701881be" returned: 0 in 0.269s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-quobyte-17b3e3a8-ad08-4a8e-86b3-795b701881be" released by "delete_volume" :: held 0.758s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Created reservations ['37abecc6-a3a5-4bc8-8177-65ae9540ce08', '49ec2797-384a-4f56-9eb4-40988c640cfe', 'de387fef-c441-4863-8804-d09f36072810', '178fce15-cbcc-4eac-bfbd-7f508e15689a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:56 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:38:56 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bf529cdf-3a38-45e6-bc06-bad4323d34a9 tempest-VolumesExtendTest-665103250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bf529cdf-3a38-45e6-bc06-bad4323d34a9 tempest-VolumesExtendTest-665103250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfa2368-83de-41bb-af2a-7e6c3a4fc982]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bf529cdf-3a38-45e6-bc06-bad4323d34a9 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:56 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd" returned: 0 in 0.460s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:56 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd Jul 17 15:38:56 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:56 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e Jul 17 15:38:56 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:56 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.261s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:38:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Deleted volume successfully. Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-098dd37e-7f2a-46b1-a1d1-e79f1e60317d tempest-VolumesSnapshotListTestJSON-1488075714 None] Lock "cinder-17b3e3a8-ad08-4a8e-86b3-795b701881be-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:56 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b.11099872-bbd7-4695-bcc0-c0b43cc420dd" returned: 0 in 0.270s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-quobyte-11099872-bbd7-4695-bcc0-c0b43cc420dd" released by "_delete_snapshot" :: held 1.655s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-quobyte-8a7b4acd-209f-43da-9969-9ed455dd560b" released by "delete_snapshot" :: held 1.688s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:56 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bf529cdf-3a38-45e6-bc06-bad4323d34a9 tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e" returned: 0 in 0.441s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bf529cdf-3a38-45e6-bc06-bad4323d34a9 tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b 2G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:56 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Created reservations ['2e8ccde2-69ce-4cd3-8855-564f6205c42f', 'b816078a-6618-4f41-a018-b8895392c331', '569452ca-26fb-42b5-94d7-89718aad63f3', '1fc457b7-1b98-42fe-9cae-f4663d1e5f6d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Delete snapshot completed successfully. Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5ce98d24-4541-4829-af2d-b756f22a25b7 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-11099872-bbd7-4695-bcc0-c0b43cc420dd-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bf529cdf-3a38-45e6-bc06-bad4323d34a9 tempest-VolumesExtendTest-665103250 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b 2G" returned: 0 in 0.164s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bf529cdf-3a38-45e6-bc06-bad4323d34a9 tempest-VolumesExtendTest-665103250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.646s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:57 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-bf529cdf-3a38-45e6-bc06-bad4323d34a9 tempest-VolumesExtendTest-665103250 None] Extend volume completed successfully. Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Acquiring lock "cinder-8a7b4acd-209f-43da-9969-9ed455dd560b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-8a7b4acd-209f-43da-9969-9ed455dd560b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Acquiring lock "cinder-quobyte-8a7b4acd-209f-43da-9969-9ed455dd560b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-quobyte-8a7b4acd-209f-43da-9969-9ed455dd560b" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cbbee3-9464-4f4d-9df4-36a4875dc6e7]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:57 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b Jul 17 15:38:57 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Acquiring lock "cinder-81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Lock "cinder-81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Acquiring lock "cinder-quobyte-4339473e-71f1-464f-9bb9-1b473ea81f5e" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Lock "cinder-quobyte-4339473e-71f1-464f-9bb9-1b473ea81f5e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Acquiring lock "cinder-quobyte-81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Lock "cinder-quobyte-81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Deleting offline snapshot 81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b of volume 4339473e-71f1-464f-9bb9-1b473ea81f5e {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] snapshot_file for this snap is: volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1939543-31b8-4b2e-8704-aeb6c295c494]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:57 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b Jul 17 15:38:57 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:57 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b" returned: 0 in 0.442s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:57 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b Jul 17 15:38:57 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:58 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-8a7b4acd-209f-43da-9969-9ed455dd560b" returned: 0 in 0.279s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:58 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b" returned: 0 in 0.468s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4339473e-71f1-464f-9bb9-1b473ea81f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-quobyte-8a7b4acd-209f-43da-9969-9ed455dd560b" released by "delete_volume" :: held 0.814s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e18916-e9a3-49f6-8c91-a3b7763ad4eb]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Created reservations ['6d730def-4923-4b78-8979-5925b8fd57a7', 'f8dcf206-9c5e-4da9-8e66-b5eaaf7c2c89', '661797c3-b6a8-4234-bf2e-3ff4dd529eda', '13db5359-9ed7-46ea-90d9-35263d1da793'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:38:58 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e Jul 17 15:38:58 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:58 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:38:58 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:58 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.260s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:38:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Deleted volume successfully. Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4d70afc1-7d6e-4f23-a87e-d1121a645244 tempest-VolumesSnapshotNegativeTestJSON-773622177 None] Lock "cinder-8a7b4acd-209f-43da-9969-9ed455dd560b-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:58 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e" returned: 0 in 0.482s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:58 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b Jul 17 15:38:58 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:59 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b" returned: 0 in 0.442s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:38:59 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b Jul 17 15:38:59 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:38:59 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e.81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b" returned: 0 in 0.282s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Lock "cinder-quobyte-81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b" released by "_delete_snapshot" :: held 1.808s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Lock "cinder-quobyte-4339473e-71f1-464f-9bb9-1b473ea81f5e" released by "delete_snapshot" :: held 1.832s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Created reservations ['9b59bf72-2032-4850-b31f-359d38ca6d1e', '44e2dfc5-1162-45c8-80cd-44dc6f8e0725', 'df826415-1b5f-4031-85bf-f7e25ef1a8d4', 'af5c3139-f8d6-44f5-999d-e95e7f484425'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:38:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Delete snapshot completed successfully. Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c94e7a90-3a32-47ca-a2e3-0a781d93f82b tempest-VolumesExtendTest-665103250 None] Lock "cinder-81e630b0-b7c7-4f2d-bc7e-189ce2e15d6b-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Acquiring lock "cinder-4339473e-71f1-464f-9bb9-1b473ea81f5e-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Lock "cinder-4339473e-71f1-464f-9bb9-1b473ea81f5e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:38:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Acquiring lock "cinder-quobyte-4339473e-71f1-464f-9bb9-1b473ea81f5e" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Lock "cinder-quobyte-4339473e-71f1-464f-9bb9-1b473ea81f5e" acquired by "delete_volume" :: waited 0.035s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (eb66388a-7fff-4b6f-8294-5b02893ffc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7956c903-38a0-46f1-a009-e1a51634f442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89435be-1a80-4bd4-a3f5-4de47bc08103]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7956c903-38a0-46f1-a009-e1a51634f442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1815992907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870c1c59-ff86-4058-b94d-3f4ab43fd7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:00Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b929377-cb7c-4fec-8c1e-49ba4cb92f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b929377-cb7c-4fec-8c1e-49ba4cb92f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d4aa60-f2b9-4601-b31e-c773d55705bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d4aa60-f2b9-4601-b31e-c773d55705bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870c1c59-ff86-4058-b94d-3f4ab43fd7d5', 'volume_name': 'volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15c1abd-cda9-491f-a2ef-4881b090d320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15c1abd-cda9-491f-a2ef-4881b090d320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50318635-5013-401f-9f4d-2ecd445343d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Volume 870c1c59-ff86-4058-b94d-3f4ab43fd7d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5', 'volume_size': 1} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1815992907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870c1c59-ff86-4058-b94d-3f4ab43fd7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:00Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Creating volume 870c1c59-ff86-4058-b94d-3f4ab43fd7d5 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:00 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:00 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 1073741824 Jul 17 15:39:00 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:00 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e Jul 17 15:39:00 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (49bb9b9a-3a76-4f14-8de0-7246be12e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67628d90-0b41-4b97-a1b8-23faef80c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67628d90-0b41-4b97-a1b8-23faef80c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1959251373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1aeb69-e5a3-4c82-acd5-44f12936d55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:00Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf35052-916d-47d8-a0f4-1ce5c42968e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf35052-916d-47d8-a0f4-1ce5c42968e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:00 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d2daac-6a61-4c24-bd01-90816f197942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d2daac-6a61-4c24-bd01-90816f197942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1aeb69-e5a3-4c82-acd5-44f12936d55b', 'volume_name': 'volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b032224-70bb-4eab-926c-72206e57882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b032224-70bb-4eab-926c-72206e57882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f964e48-3ad6-4080-83b6-518b69aba091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:00 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Volume bc1aeb69-e5a3-4c82-acd5-44f12936d55b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b', 'volume_size': 1} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e" returned: 0 in 0.523s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:00 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e Jul 17 15:39:00 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:00 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 1073741824" returned: 0 in 0.682s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:00 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4339473e-71f1-464f-9bb9-1b473ea81f5e" returned: 0 in 0.327s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:00 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 Jul 17 15:39:00 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Lock "cinder-quobyte-4339473e-71f1-464f-9bb9-1b473ea81f5e" released by "delete_volume" :: held 0.976s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (4ad6a712-99a7-4cd2-b3f9-3517aaf4ec20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9089fc-328c-49dd-a148-a6c7cfd4c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9089fc-328c-49dd-a148-a6c7cfd4c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546335629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda232f1-a259-4144-99e3-5f2c2b4cf016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:01Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9c55b1-e8f2-4333-a3ba-32a8efa25fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9c55b1-e8f2-4333-a3ba-32a8efa25fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d40699-cdd2-4ec3-9d96-5147de414105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d40699-cdd2-4ec3-9d96-5147de414105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda232f1-a259-4144-99e3-5f2c2b4cf016', 'volume_name': 'volume-dda232f1-a259-4144-99e3-5f2c2b4cf016', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067a9433-3919-4aa1-983f-96ecd3554932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067a9433-3919-4aa1-983f-96ecd3554932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccb2b20-f7e1-4ccc-812b-291be903f2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Volume dda232f1-a259-4144-99e3-5f2c2b4cf016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda232f1-a259-4144-99e3-5f2c2b4cf016', 'volume_size': 1} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Created reservations ['7d8e0a42-426f-44ec-8186-915a604d4668', '5fd0176d-5d66-43b7-a8ac-e90bdcc2bec2', '8298d8c2-179b-46a7-a19f-b38dc5b1c539', 'c50224dd-f494-47f7-964a-36d2b4d3695e'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:01 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5" returned: 0 in 0.398s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1959251373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1aeb69-e5a3-4c82-acd5-44f12936d55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:00Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Creating volume bc1aeb69-e5a3-4c82-acd5-44f12936d55b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:01 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:01 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:01 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50318635-5013-401f-9f4d-2ecd445343d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b 1073741824 Jul 17 15:39:01 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320ed3dd-f554-4cfe-bdfc-6360b1a345b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Volume volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 (870c1c59-ff86-4058-b94d-3f4ab43fd7d5): created successfully Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320ed3dd-f554-4cfe-bdfc-6360b1a345b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (eb66388a-7fff-4b6f-8294-5b02893ffc22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:01 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0fadde08-f7ef-41b9-8a93-25a670dc96f4 tempest-CreateVolumesFromImageTest-1059780166 None] Created volume successfully. Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (4e6a0b4c-0b00-4f31-b983-c51d04a29604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2941c916-bc85-4edd-817c-8e776e70907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2941c916-bc85-4edd-817c-8e776e70907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-399477571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8692a97-f9a1-4f7f-aae6-5a11305e3229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:01Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed5a070-bd5a-4390-8925-7980aad0244c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed5a070-bd5a-4390-8925-7980aad0244c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4223c422-abf6-4a43-86db-7027cf5c3df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4223c422-abf6-4a43-86db-7027cf5c3df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8692a97-f9a1-4f7f-aae6-5a11305e3229', 'volume_name': 'volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1992aea4-e8eb-4912-b779-d931ca9d5f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1992aea4-e8eb-4912-b779-d931ca9d5f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fc9c60-02dd-4710-923d-6dc8e0de5ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:01 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Volume e8692a97-f9a1-4f7f-aae6-5a11305e3229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229', 'volume_size': 1} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:01 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.367s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:01 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Deleted volume successfully. Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6a96b36d-4bfa-41d3-a47c-58ec4970db0e tempest-VolumesExtendTest-665103250 None] Lock "cinder-4339473e-71f1-464f-9bb9-1b473ea81f5e-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:01 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (ccab3ebb-b746-468d-b1d9-944c0f27fb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344f7e3c-cadd-4fb1-88a3-c6f4b631cea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344f7e3c-cadd-4fb1-88a3-c6f4b631cea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-740771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea836f86-e790-45a4-862c-d94fa1e8c4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:02Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a7a935-d9a6-4197-9411-f8adca304bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a7a935-d9a6-4197-9411-f8adca304bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7768aa0c-5528-4542-8d5b-791d5266b492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7768aa0c-5528-4542-8d5b-791d5266b492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea836f86-e790-45a4-862c-d94fa1e8c4c5', 'volume_name': 'volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c89aa9b-f841-4669-8547-1ce97d3c8a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c89aa9b-f841-4669-8547-1ce97d3c8a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecef5fae-77aa-4bbd-bd50-dd808122ec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:02 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Volume ea836f86-e790-45a4-862c-d94fa1e8c4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5', 'volume_size': 1} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:02 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b 1073741824" returned: 0 in 0.752s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:02 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b Jul 17 15:39:02 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:02 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546335629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda232f1-a259-4144-99e3-5f2c2b4cf016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:01Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Creating volume dda232f1-a259-4144-99e3-5f2c2b4cf016 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:02 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f964e48-3ad6-4080-83b6-518b69aba091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70d76bc-a58c-47fb-9e2b-6ef3db816923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:02 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 1073741824 Jul 17 15:39:02 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:02 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Volume volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b (bc1aeb69-e5a3-4c82-acd5-44f12936d55b): created successfully Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70d76bc-a58c-47fb-9e2b-6ef3db816923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (49bb9b9a-3a76-4f14-8de0-7246be12e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-47780615-4330-4c11-86ad-4e63314cc2c0 tempest-CreateVolumesFromImageTest-1059780166 None] Created volume successfully. Jul 17 15:39:03 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 1073741824" returned: 0 in 0.664s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:03 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 Jul 17 15:39:03 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:03 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016" returned: 0 in 0.300s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.822s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-399477571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8692a97-f9a1-4f7f-aae6-5a11305e3229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:01Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Creating volume e8692a97-f9a1-4f7f-aae6-5a11305e3229 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:03 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:03 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 1073741824 Jul 17 15:39:03 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccb2b20-f7e1-4ccc-812b-291be903f2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda232f1-a259-4144-99e3-5f2c2b4cf016', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63723ce5-ba21-4000-9bb5-f4d718623f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:03 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Volume volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 (dda232f1-a259-4144-99e3-5f2c2b4cf016): created successfully Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63723ce5-ba21-4000-9bb5-f4d718623f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (4ad6a712-99a7-4cd2-b3f9-3517aaf4ec20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:03 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-03fb0f91-e1a7-4c95-b185-df9ec6aaa0bb tempest-CreateVolumesFromImageTest-1059780166 None] Created volume successfully. Jul 17 15:39:04 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 1073741824" returned: 0 in 0.542s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:04 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 Jul 17 15:39:04 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:04 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229" returned: 0 in 0.331s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.315s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-740771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea836f86-e790-45a4-862c-d94fa1e8c4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2d57e5fb324c36ac0a28fb94f2126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:02Z,use_quota=True,user_id='f55fecf7891f4abdb1c40cf16dd6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Creating volume ea836f86-e790-45a4-862c-d94fa1e8c4c5 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:04 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fc9c60-02dd-4710-923d-6dc8e0de5ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5036c5b3-3fac-4ef4-8f16-711385b231e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:04 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 1073741824 Jul 17 15:39:04 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:04 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Volume volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 (e8692a97-f9a1-4f7f-aae6-5a11305e3229): created successfully Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5036c5b3-3fac-4ef4-8f16-711385b231e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (4e6a0b4c-0b00-4f31-b983-c51d04a29604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2f619557-b9d2-41b0-a744-85c4b92a740f tempest-CreateVolumesFromImageTest-1059780166 None] Created volume successfully. Jul 17 15:39:04 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 1073741824" returned: 0 in 0.546s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:05 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 Jul 17 15:39:05 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:05 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5" returned: 0 in 0.294s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecef5fae-77aa-4bbd-bd50-dd808122ec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4129ed4-04b4-4f4f-b41d-dfe988bbbcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:05 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Volume volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 (ea836f86-e790-45a4-862c-d94fa1e8c4c5): created successfully Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4129ed4-04b4-4f4f-b41d-dfe988bbbcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Flow 'volume_create_manager' (ccab3ebb-b746-468d-b1d9-944c0f27fb87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:05 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-90c891db-eac7-4264-ad9a-ff689dffcc86 tempest-CreateVolumesFromImageTest-1059780166 None] Created volume successfully. Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-ea836f86-e790-45a4-862c-d94fa1e8c4c5-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-ea836f86-e790-45a4-862c-d94fa1e8c4c5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-quobyte-ea836f86-e790-45a4-862c-d94fa1e8c4c5" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-ea836f86-e790-45a4-862c-d94fa1e8c4c5" acquired by "delete_volume" :: waited 0.033s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bf202b-36bf-4c08-892b-134a93c897ce]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:05 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 Jul 17 15:39:05 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:06 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5" returned: 0 in 0.444s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:06 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5 Jul 17 15:39:06 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:06 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ea836f86-e790-45a4-862c-d94fa1e8c4c5" returned: 0 in 0.296s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-ea836f86-e790-45a4-862c-d94fa1e8c4c5" released by "delete_volume" :: held 0.791s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Created reservations ['323d7a61-faeb-4e79-9542-a95c51e24d36', 'e4ac27e4-0985-4154-afcd-6d7eb081d62c', '290f8d63-bdb5-4881-bfc3-9909ae8c6a1d', 'da5c4bb2-96a0-4e73-af07-de97f9789a17'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:06 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:06 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-e8692a97-f9a1-4f7f-aae6-5a11305e3229-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-e8692a97-f9a1-4f7f-aae6-5a11305e3229-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:06 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.327s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-quobyte-e8692a97-f9a1-4f7f-aae6-5a11305e3229" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Deleted volume successfully. Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-e8692a97-f9a1-4f7f-aae6-5a11305e3229" acquired by "delete_volume" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9684837-be7e-46e3-ae69-6d6c6e551202 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-ea836f86-e790-45a4-862c-d94fa1e8c4c5-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f757fc-f258-4855-a3ea-390284787bf3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:07 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 Jul 17 15:39:07 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:07 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229" returned: 0 in 0.384s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:07 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229 Jul 17 15:39:07 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:07 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e8692a97-f9a1-4f7f-aae6-5a11305e3229" returned: 0 in 0.324s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-e8692a97-f9a1-4f7f-aae6-5a11305e3229" released by "delete_volume" :: held 0.791s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Created reservations ['abc4be2a-6d4b-43fe-b861-0d0a6ebfba36', 'dcc45604-e98b-4f51-9cec-d4c1c220a1ad', 'f8a26110-5138-4dc2-9a1e-fbb9a2360b0b', '1d2cb248-4ce0-462c-aa73-0671438bda51'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:07 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:07 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-dda232f1-a259-4144-99e3-5f2c2b4cf016-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-dda232f1-a259-4144-99e3-5f2c2b4cf016-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-quobyte-dda232f1-a259-4144-99e3-5f2c2b4cf016" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-dda232f1-a259-4144-99e3-5f2c2b4cf016" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d177715-032b-436b-973c-4b86eee5cf74]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:08 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.395s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:08 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Deleted volume successfully. Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1caae1ea-9629-4890-b608-cb38d7d82ad3 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-e8692a97-f9a1-4f7f-aae6-5a11305e3229-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:08 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 Jul 17 15:39:08 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:08 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016" returned: 0 in 0.439s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:08 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016 Jul 17 15:39:08 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:08 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dda232f1-a259-4144-99e3-5f2c2b4cf016" returned: 0 in 0.303s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-dda232f1-a259-4144-99e3-5f2c2b4cf016" released by "delete_volume" :: held 0.806s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Created reservations ['7e6ac419-d689-41ed-bf7b-0ce4313f74a9', '74185e98-279d-42fa-9027-614c8e9f2495', '4d705c17-ed11-4276-8e7f-09190a18c31f', '0118650b-2129-423f-b979-cebb934e208c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:09 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:09 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-bc1aeb69-e5a3-4c82-acd5-44f12936d55b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-bc1aeb69-e5a3-4c82-acd5-44f12936d55b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-quobyte-bc1aeb69-e5a3-4c82-acd5-44f12936d55b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-bc1aeb69-e5a3-4c82-acd5-44f12936d55b" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42872e0-6a83-4fd2-b63e-4a2716dd9c1e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:09 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b Jul 17 15:39:09 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:09 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.434s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Deleted volume successfully. Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a72258d1-57a6-480e-9d61-a874876411e9 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-dda232f1-a259-4144-99e3-5f2c2b4cf016-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:09 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b" returned: 0 in 0.451s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:09 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b Jul 17 15:39:09 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:10 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc1aeb69-e5a3-4c82-acd5-44f12936d55b" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-bc1aeb69-e5a3-4c82-acd5-44f12936d55b" released by "delete_volume" :: held 0.800s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Created reservations ['50077375-369e-41dc-a2af-ce454c4e7b65', 'fa6fef7a-6cea-4930-80d2-14cb52c8d47c', 'e51375b5-f51a-488b-ab0a-74bd346684d1', 'ccaf360d-1568-466e-a2ae-385cd1941bb8'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:10 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:10 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-870c1c59-ff86-4058-b94d-3f4ab43fd7d5-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-870c1c59-ff86-4058-b94d-3f4ab43fd7d5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "cinder-quobyte-870c1c59-ff86-4058-b94d-3f4ab43fd7d5" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:10 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.329s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:10 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Deleted volume successfully. Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-870c1c59-ff86-4058-b94d-3f4ab43fd7d5" acquired by "delete_volume" :: waited 0.039s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[be82ab8d-a044-4afb-9dd7-5a6624670e86]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-55109606-a836-43ab-836a-2ff0310db72d tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-bc1aeb69-e5a3-4c82-acd5-44f12936d55b-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:10 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 Jul 17 15:39:10 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:11 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5" returned: 0 in 0.519s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:11 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5 Jul 17 15:39:11 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:11 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-870c1c59-ff86-4058-b94d-3f4ab43fd7d5" returned: 0 in 0.294s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-quobyte-870c1c59-ff86-4058-b94d-3f4ab43fd7d5" released by "delete_volume" :: held 0.879s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Created reservations ['4f89c746-0347-4ced-80f6-24102e409829', 'ec0f6dbd-305c-4afe-8c18-a84b11c453ea', '27223e13-af16-4209-9ccd-dc8095af0341', 'd0550e89-951e-47be-b2d8-00cb5d848539'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:11 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:11 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:12 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.322s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:12 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:12 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Deleted volume successfully. Jul 17 15:39:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ce5f1a82-47da-4c1f-8002-c610ca561069 tempest-CreateVolumesFromImageTest-1059780166 None] Lock "cinder-870c1c59-ff86-4058-b94d-3f4ab43fd7d5-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (ceda6c5c-15fc-47cb-92b7-d5cd4de9eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc7ec11-0fc3-41a4-8586-37558f0f557e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc7ec11-0fc3-41a4-8586-37558f0f557e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022641822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad34de2-8a73-48f2-b770-b213d100bde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:20Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5d758a-e6cb-4c8b-bc24-24bc753f8b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5d758a-e6cb-4c8b-bc24-24bc753f8b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1b684f-d9e2-436d-b35a-5ce723aece2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1b684f-d9e2-436d-b35a-5ce723aece2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad34de2-8a73-48f2-b770-b213d100bde3', 'volume_name': 'volume-bad34de2-8a73-48f2-b770-b213d100bde3', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ca0b2b-8741-45db-85d9-ff82e3ced819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ca0b2b-8741-45db-85d9-ff82e3ced819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4668bd66-5f6e-410f-8aa1-e5cbf4c02977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:19 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume bad34de2-8a73-48f2-b770-b213d100bde3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad34de2-8a73-48f2-b770-b213d100bde3', 'volume_size': 1} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022641822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad34de2-8a73-48f2-b770-b213d100bde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:20Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Creating volume bad34de2-8a73-48f2-b770-b213d100bde3 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:19 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:19 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3 1073741824 Jul 17 15:39:19 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:20 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3 1073741824" returned: 0 in 0.515s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:20 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3 Jul 17 15:39:20 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:20 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3" returned: 0 in 0.281s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4668bd66-5f6e-410f-8aa1-e5cbf4c02977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad34de2-8a73-48f2-b770-b213d100bde3', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669414b5-9d32-4ca8-ab5f-3f6ddce58c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume volume-bad34de2-8a73-48f2-b770-b213d100bde3 (bad34de2-8a73-48f2-b770-b213d100bde3): created successfully Jul 17 15:39:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669414b5-9d32-4ca8-ab5f-3f6ddce58c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (ceda6c5c-15fc-47cb-92b7-d5cd4de9eba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:20 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-492c1b96-f5b2-42d8-9668-131de2004448 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created volume successfully. Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (f9723b1a-2a74-4f20-9e6b-9c647769409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6d83e0-0966-4f00-81b4-68af14ad5dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6d83e0-0966-4f00-81b4-68af14ad5dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-605348384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1613ca-76d0-48b5-971c-f94afa0e9a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:22Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1028828-00f5-4ede-8212-f13f76697d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1028828-00f5-4ede-8212-f13f76697d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e428f59-8f2a-4c54-94b4-cd537879b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e428f59-8f2a-4c54-94b4-cd537879b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1613ca-76d0-48b5-971c-f94afa0e9a89', 'volume_name': 'volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d08f1ec-4485-4833-8222-779dc5a8330f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d08f1ec-4485-4833-8222-779dc5a8330f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0f1b85-4d45-44a8-8dcb-67887c3235bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:22 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume dc1613ca-76d0-48b5-971c-f94afa0e9a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89', 'volume_size': 1} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-605348384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1613ca-76d0-48b5-971c-f94afa0e9a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:22Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Creating volume dc1613ca-76d0-48b5-971c-f94afa0e9a89 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:22 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:22 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 1073741824 Jul 17 15:39:22 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:22 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:22 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (92767b33-98ed-4807-be94-a272266c94d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42c2c58-f4c3-444e-ac36-e5c74572a721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42c2c58-f4c3-444e-ac36-e5c74572a721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403142917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce31ed41-61d0-49b3-b1e4-05d027c96d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:23Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6087abe2-387d-4449-8715-00f2ba2e8257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6087abe2-387d-4449-8715-00f2ba2e8257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1589b91-dbef-465a-937a-826528fd6dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1589b91-dbef-465a-937a-826528fd6dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce31ed41-61d0-49b3-b1e4-05d027c96d9e', 'volume_name': 'volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a76ffc-4057-4914-907e-b96e274c17a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a76ffc-4057-4914-907e-b96e274c17a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9ca357-a5b2-4a7d-bf44-40fea0306a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume ce31ed41-61d0-49b3-b1e4-05d027c96d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e', 'volume_size': 1} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.548s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:39:23 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 1073741824" returned: 0 in 0.720s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:23 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 Jul 17 15:39:23 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (1153f34d-7a0f-4b5b-b0c7-f311888c9cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50037006-de97-4aab-88b0-c1f335fea95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50037006-de97-4aab-88b0-c1f335fea95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248090883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:24Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981b4d8e-3d95-4f15-89d4-2a1425b0524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981b4d8e-3d95-4f15-89d4-2a1425b0524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b148ab-b713-4d25-938e-7b66fa8c1a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b148ab-b713-4d25-938e-7b66fa8c1a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2', 'volume_name': 'volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1eb56d-cc9b-4e51-a995-743c4c03d6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1eb56d-cc9b-4e51-a995-743c4c03d6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47c1d33-fa6a-4cfc-b3ad-0d8cb2670f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume 38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2', 'volume_size': 1} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:23 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89" returned: 0 in 0.303s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.416s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403142917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce31ed41-61d0-49b3-b1e4-05d027c96d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:23Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Creating volume ce31ed41-61d0-49b3-b1e4-05d027c96d9e {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:23 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0f1b85-4d45-44a8-8dcb-67887c3235bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ab18bb-3656-40f9-a19c-da468ffbd454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:23 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e 1073741824 Jul 17 15:39:23 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:23 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 (dc1613ca-76d0-48b5-971c-f94afa0e9a89): created successfully Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ab18bb-3656-40f9-a19c-da468ffbd454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (f9723b1a-2a74-4f20-9e6b-9c647769409a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f7cd8f8a-5469-4d8c-bf68-8ce35ae06143 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created volume successfully. Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (8d1a42e5-d3bf-4b8c-a362-c0dbf3c5e057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeee1a9-9c84-4483-8d88-29dc2ecff73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeee1a9-9c84-4483-8d88-29dc2ecff73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528867281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdf363d-2558-4f39-a5c6-c6f94dabb725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:24Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e872d121-3361-4cbf-abf0-e722a1d283bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e872d121-3361-4cbf-abf0-e722a1d283bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0988c057-ecc0-481d-a718-839e3d8422d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0988c057-ecc0-481d-a718-839e3d8422d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbdf363d-2558-4f39-a5c6-c6f94dabb725', 'volume_name': 'volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:24 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67f419a-e1e8-46cd-aeea-269d05c86ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67f419a-e1e8-46cd-aeea-269d05c86ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a54617-1377-4fc8-afed-6815d14dbf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:24 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume bbdf363d-2558-4f39-a5c6-c6f94dabb725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725', 'volume_size': 1} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e 1073741824" returned: 0 in 0.723s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:24 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e Jul 17 15:39:24 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:24 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e" returned: 0 in 0.369s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248090883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:24Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Creating volume 38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:24 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:24 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 1073741824 Jul 17 15:39:24 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (60920302-cfa7-435c-8d9f-6b0803d5a6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0f1a82-d191-4943-b667-a5c29511e8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0f1a82-d191-4943-b667-a5c29511e8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713611609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbabc2d-00ad-4c89-9732-a2b817bb9c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:25Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97014708-be52-40fc-8273-4ebf0776dce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97014708-be52-40fc-8273-4ebf0776dce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a7ee2a-354f-47a6-be9d-fe54bc60c181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a7ee2a-354f-47a6-be9d-fe54bc60c181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddbabc2d-00ad-4c89-9732-a2b817bb9c51', 'volume_name': 'volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f37189-dd86-4752-97db-441d9ec5dc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f37189-dd86-4752-97db-441d9ec5dc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaaef610-c1cf-4108-a775-05be411f3158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:25 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume ddbabc2d-00ad-4c89-9732-a2b817bb9c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51', 'volume_size': 1} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9ca357-a5b2-4a7d-bf44-40fea0306a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f1accf-dec4-4005-9296-126a17bf5c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:25 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e (ce31ed41-61d0-49b3-b1e4-05d027c96d9e): created successfully Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f1accf-dec4-4005-9296-126a17bf5c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (92767b33-98ed-4807-be94-a272266c94d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-829f6628-5d76-4120-a1bb-5d8621bf1587 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created volume successfully. Jul 17 15:39:25 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 1073741824" returned: 0 in 0.569s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:25 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 Jul 17 15:39:25 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:25 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528867281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdf363d-2558-4f39-a5c6-c6f94dabb725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:24Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Creating volume bbdf363d-2558-4f39-a5c6-c6f94dabb725 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:25 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47c1d33-fa6a-4cfc-b3ad-0d8cb2670f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc86d1d-46c0-4848-b586-1abecff92dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:25 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 1073741824 Jul 17 15:39:25 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:25 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 (38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2): created successfully Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc86d1d-46c0-4848-b586-1abecff92dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (1153f34d-7a0f-4b5b-b0c7-f311888c9cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-65f16f0d-6e0f-4f09-955a-6d0ca9a8df81 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created volume successfully. Jul 17 15:39:26 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 1073741824" returned: 0 in 0.619s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:26 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 Jul 17 15:39:26 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:26 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725" returned: 0 in 0.454s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.881s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713611609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbabc2d-00ad-4c89-9732-a2b817bb9c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b273da2b3f46648e256f96a4211ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:25Z,use_quota=True,user_id='5e8eb07242ba4aa5b1bab2d1a859f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Creating volume ddbabc2d-00ad-4c89-9732-a2b817bb9c51 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:26 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=129,cinder:UPDATE=186,cinder:INSERT=54,cinder:DELETE=10 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:39:26 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 1073741824 Jul 17 15:39:27 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a54617-1377-4fc8-afed-6815d14dbf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985692ef-0957-4480-88cd-62ed716e4593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=161,cinder:SELECT=147,cinder:DELETE=20,cinder:INSERT=41 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:39:27 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 (bbdf363d-2558-4f39-a5c6-c6f94dabb725): created successfully Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985692ef-0957-4480-88cd-62ed716e4593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (8d1a42e5-d3bf-4b8c-a362-c0dbf3c5e057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:27 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-21d60086-ae62-444f-96f4-c0a0dc3aad80 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created volume successfully. Jul 17 15:39:27 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 1073741824" returned: 0 in 0.578s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:27 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 Jul 17 15:39:27 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:27 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51" returned: 0 in 0.310s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaaef610-c1cf-4108-a775-05be411f3158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b4afd3-5f69-476c-95cb-e24390ae399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:27 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Volume volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 (ddbabc2d-00ad-4c89-9732-a2b817bb9c51): created successfully Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b4afd3-5f69-476c-95cb-e24390ae399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Flow 'volume_create_manager' (60920302-cfa7-435c-8d9f-6b0803d5a6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:27 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-49bd388c-a234-4ea8-93a1-010007858eab tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created volume successfully. Jul 17 15:39:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-ddbabc2d-00ad-4c89-9732-a2b817bb9c51-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-ddbabc2d-00ad-4c89-9732-a2b817bb9c51-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-quobyte-ddbabc2d-00ad-4c89-9732-a2b817bb9c51" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-ddbabc2d-00ad-4c89-9732-a2b817bb9c51" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:28 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9614414c-ebfd-43ad-a4d8-5a2dccc63996]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:28 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 Jul 17 15:39:28 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:29 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51" returned: 0 in 0.447s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:29 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51 Jul 17 15:39:29 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:29 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ddbabc2d-00ad-4c89-9732-a2b817bb9c51" returned: 0 in 0.289s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-ddbabc2d-00ad-4c89-9732-a2b817bb9c51" released by "delete_volume" :: held 0.794s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created reservations ['48d1c8e2-3bb2-42ec-a394-df88d11e11f6', 'dcaf94e7-2399-4b5b-97f1-cb1320f5933e', '98225a8c-0142-43da-b887-7a2aba25a225', '673522d0-7042-48a6-a899-16ed369bc012'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:29 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:29 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-bbdf363d-2558-4f39-a5c6-c6f94dabb725-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-bbdf363d-2558-4f39-a5c6-c6f94dabb725-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-quobyte-bbdf363d-2558-4f39-a5c6-c6f94dabb725" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-bbdf363d-2558-4f39-a5c6-c6f94dabb725" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[26274d70-7306-483c-9aa7-2eccaf7ba501]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:29 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.421s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:29 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:29 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Deleted volume successfully. Jul 17 15:39:29 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 Jul 17 15:39:29 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99b8c662-b857-4962-97a7-57cc5053d493 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-ddbabc2d-00ad-4c89-9732-a2b817bb9c51-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:30 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725" returned: 0 in 0.424s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:30 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725 Jul 17 15:39:30 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:30 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bbdf363d-2558-4f39-a5c6-c6f94dabb725" returned: 0 in 0.274s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-bbdf363d-2558-4f39-a5c6-c6f94dabb725" released by "delete_volume" :: held 0.766s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created reservations ['ec1f5cf1-8a47-4a3d-8fee-4338f5859473', '7fd0356f-5724-4de5-b8bd-f379cb96875d', '043a6bfc-3cf5-4629-88e8-a29ec74868fa', '0b7865bc-f4a2-443b-9f33-b017458f52c6'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:30 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:30 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-quobyte-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[377851fd-676e-4d17-b966-5c7ad9efa44e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:31 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.479s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:31 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Deleted volume successfully. Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76827e1e-c361-4cd6-8a3f-ec5d18100a29 tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-bbdf363d-2558-4f39-a5c6-c6f94dabb725-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:31 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 Jul 17 15:39:31 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:31 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2" returned: 0 in 0.471s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:31 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2 Jul 17 15:39:31 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:31 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2" returned: 0 in 0.320s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2" released by "delete_volume" :: held 0.851s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:31 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created reservations ['5a6480c4-4ee3-457a-8831-e61355bafc05', 'fa64fe0c-f08b-4cc6-b100-c6b9f06fc9aa', '93e0ed3a-5b50-4631-bdd0-87f4fee4c834', 'e5cc687d-523c-4b13-a032-2026c37d78fd'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:32 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:32 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-ce31ed41-61d0-49b3-b1e4-05d027c96d9e-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-ce31ed41-61d0-49b3-b1e4-05d027c96d9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-quobyte-ce31ed41-61d0-49b3-b1e4-05d027c96d9e" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-ce31ed41-61d0-49b3-b1e4-05d027c96d9e" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4650eaa4-fb0a-410e-b290-1af971cb2d48]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:32 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.391s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Deleted volume successfully. Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-139f86fe-6bcf-4610-9044-92b940c524ed tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-38aa2cf5-7e4e-4bbd-bdf7-4a1a31c266a2-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:32 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e Jul 17 15:39:32 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:32 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e" returned: 0 in 0.577s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:33 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e Jul 17 15:39:33 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:33 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ce31ed41-61d0-49b3-b1e4-05d027c96d9e" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-ce31ed41-61d0-49b3-b1e4-05d027c96d9e" released by "delete_volume" :: held 1.014s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created reservations ['e21c3125-109f-490f-8686-2795a1603931', 'd4661af5-1ada-49dd-99c9-53c48ebc45b6', '0b4e1905-76ad-470e-9fd6-a57525427bac', '3cf36800-58df-4aa2-913d-97c7fc21bd6c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:33 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:33 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:33 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.295s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:33 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Deleted volume successfully. Jul 17 15:39:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-51160758-f8ea-4f15-a2da-6cb7097cf1ad tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-ce31ed41-61d0-49b3-b1e4-05d027c96d9e-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-dc1613ca-76d0-48b5-971c-f94afa0e9a89-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-dc1613ca-76d0-48b5-971c-f94afa0e9a89-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-quobyte-dc1613ca-76d0-48b5-971c-f94afa0e9a89" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-dc1613ca-76d0-48b5-971c-f94afa0e9a89" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:34 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf1c5f3-038c-4d5e-a543-f5d879b18e2b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:34 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 Jul 17 15:39:34 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:35 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89" returned: 0 in 0.407s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:35 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89 Jul 17 15:39:35 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:35 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dc1613ca-76d0-48b5-971c-f94afa0e9a89" returned: 0 in 0.401s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-dc1613ca-76d0-48b5-971c-f94afa0e9a89" released by "delete_volume" :: held 0.864s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created reservations ['a9cb13ea-5088-4a2d-9300-2cb87e89642c', '7d4da87f-f78e-4943-9d93-566aea072372', 'b92e08d8-ff45-4a73-a616-1b91e105830f', 'ebece7cc-eeaa-46b8-b6a8-21cc8160c96f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:35 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:35 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-bad34de2-8a73-48f2-b770-b213d100bde3-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-bad34de2-8a73-48f2-b770-b213d100bde3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "cinder-quobyte-bad34de2-8a73-48f2-b770-b213d100bde3" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:39:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-bad34de2-8a73-48f2-b770-b213d100bde3" acquired by "delete_volume" :: waited 0.051s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:39:36 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[220f8403-357b-4a37-b9cc-e0378ceef3aa]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:39:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:36 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.561s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:36 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:36 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Deleted volume successfully. Jul 17 15:39:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4a974a1a-3d6a-4bfa-ac84-8a9fed180e1a tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-dc1613ca-76d0-48b5-971c-f94afa0e9a89-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:36 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3 Jul 17 15:39:36 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:36 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3" returned: 0 in 0.755s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:36 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3 Jul 17 15:39:36 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:37 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bad34de2-8a73-48f2-b770-b213d100bde3" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-quobyte-bad34de2-8a73-48f2-b770-b213d100bde3" released by "delete_volume" :: held 1.137s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Created reservations ['fdd51356-92e9-4c46-8986-1d6f531641de', 'f111a2fb-8054-4604-a451-44629a2ae935', '77c8332a-b53b-4a33-9512-e2c2cdaa153a', 'c29aef16-5cc6-4535-8eca-28b5b254453e'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:37 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:39:37 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:37 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.280s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:39:37 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Deleted volume successfully. Jul 17 15:39:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-22171992-8314-48e8-b6f0-23437a13abce tempest-CreateVolumesFromSourceVolumeTest-1821366893 None] Lock "cinder-bad34de2-8a73-48f2-b770-b213d100bde3-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:39:47 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=52,cinder:DELETE=7,cinder:INSERT=13,cinder:SELECT=30 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:39:47 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=32,cinder:UPDATE=50,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Flow 'volume_create_manager' (8b551640-a1d4-4424-87e8-bf958a043707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b298bbb8-12a3-4eb4-9082-8af57544de50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b298bbb8-12a3-4eb4-9082-8af57544de50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-976261272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33ab19a-7cf5-4b4a-b40a-9e22d84a04af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098afb6dbf834badb8a2b1b1094623a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:51Z,use_quota=True,user_id='a28d84f5f94e46c1bba74460a8666caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2b21f0-b3a1-42a3-ad33-39bee71a2391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2b21f0-b3a1-42a3-ad33-39bee71a2391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaa2dd4-c8af-42fb-94bc-f8ea4be6ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaa2dd4-c8af-42fb-94bc-f8ea4be6ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33ab19a-7cf5-4b4a-b40a-9e22d84a04af', 'volume_name': 'volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf854547-bbf6-4ad1-b01b-75d2de54f2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf854547-bbf6-4ad1-b01b-75d2de54f2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09d673f-9eb7-4c07-bb13-70f378b20446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Volume b33ab19a-7cf5-4b4a-b40a-9e22d84a04af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af', 'volume_size': 1} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-976261272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33ab19a-7cf5-4b4a-b40a-9e22d84a04af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098afb6dbf834badb8a2b1b1094623a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:39:51Z,use_quota=True,user_id='a28d84f5f94e46c1bba74460a8666caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Creating volume b33ab19a-7cf5-4b4a-b40a-9e22d84a04af {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:39:50 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:39:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:50 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af 1073741824 Jul 17 15:39:50 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:51 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af 1073741824" returned: 0 in 0.455s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:39:51 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af Jul 17 15:39:51 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:39:51 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 17 15:39:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af" returned: 0 in 0.245s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:39:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:39:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09d673f-9eb7-4c07-bb13-70f378b20446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d57db75-6038-4689-ac4d-af8fdff6e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:39:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Volume volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af (b33ab19a-7cf5-4b4a-b40a-9e22d84a04af): created successfully Jul 17 15:39:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d57db75-6038-4689-ac4d-af8fdff6e4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:39:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Flow 'volume_create_manager' (8b551640-a1d4-4424-87e8-bf958a043707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:39:51 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-444bb121-a77b-457c-a8be-fd3ed05a5bc0 tempest-TestMinimumBasicScenario-1492259037 None] Created volume successfully. Jul 17 15:39:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-94ff6785-5783-4ccc-a009-69f488af9066 req-8385e5ab-fd1d-4713-8b7c-0e5e640c509b tempest-TestMinimumBasicScenario-1492259037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:39:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-94ff6785-5783-4ccc-a009-69f488af9066 req-8385e5ab-fd1d-4713-8b7c-0e5e640c509b tempest-TestMinimumBasicScenario-1492259037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:39:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-94ff6785-5783-4ccc-a009-69f488af9066 req-8385e5ab-fd1d-4713-8b7c-0e5e640c509b tempest-TestMinimumBasicScenario-1492259037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:39:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-94ff6785-5783-4ccc-a009-69f488af9066 req-8385e5ab-fd1d-4713-8b7c-0e5e640c509b tempest-TestMinimumBasicScenario-1492259037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98646955-0fe2-4eff-8e3b-855dc2e2d3e7', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:39:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-94ff6785-5783-4ccc-a009-69f488af9066 req-8385e5ab-fd1d-4713-8b7c-0e5e640c509b tempest-TestMinimumBasicScenario-1492259037 None] attachment_update completed successfully. Jul 17 15:40:01 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Flow 'volume_create_manager' (6ef0b184-7b01-4253-aa64-b2215c2978fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeab6f6a-5900-4da8-a62c-3e156a345b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeab6f6a-5900-4da8-a62c-3e156a345b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2096270046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253fab0e-0ef2-4450-bbaa-823bdda5d0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b9d93b26e04633a6aab2164752866f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:40:02Z,use_quota=True,user_id='fb8b9c33bfef4e7fbe2130624158564b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff9629e-005a-4ec3-a3fe-f11de61a7eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff9629e-005a-4ec3-a3fe-f11de61a7eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e925922c-f921-4377-9c75-7e496c53f1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e925922c-f921-4377-9c75-7e496c53f1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253fab0e-0ef2-4450-bbaa-823bdda5d0ea', 'volume_name': 'volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648db423-ffa0-4d10-9624-facf716ba2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648db423-ffa0-4d10-9624-facf716ba2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c3dc56-8778-465c-a19f-59048497ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:02 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Volume 253fab0e-0ef2-4450-bbaa-823bdda5d0ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea', 'volume_size': 1} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2096270046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253fab0e-0ef2-4450-bbaa-823bdda5d0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b9d93b26e04633a6aab2164752866f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:40:02Z,use_quota=True,user_id='fb8b9c33bfef4e7fbe2130624158564b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Creating volume 253fab0e-0ef2-4450-bbaa-823bdda5d0ea {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:40:02 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:02 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea 1073741824 Jul 17 15:40:02 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:02 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea 1073741824" returned: 0 in 0.428s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:02 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea Jul 17 15:40:02 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:02 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea" returned: 0 in 0.249s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c3dc56-8778-465c-a19f-59048497ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f46d2ef-e760-402a-ba53-0acd7d013c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:02 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Volume volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea (253fab0e-0ef2-4450-bbaa-823bdda5d0ea): created successfully Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f46d2ef-e760-402a-ba53-0acd7d013c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Flow 'volume_create_manager' (6ef0b184-7b01-4253-aa64-b2215c2978fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:40:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-276a9755-4a7e-4d91-a6aa-77b384bb9597 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Created volume successfully. Jul 17 15:40:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-4c8a2750-b4b0-4e81-bcd3-f127783483e3 req-a387e499-fca9-4e06-9b25-1589c0ea33df tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:40:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-4c8a2750-b4b0-4e81-bcd3-f127783483e3 req-a387e499-fca9-4e06-9b25-1589c0ea33df tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:40:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-4c8a2750-b4b0-4e81-bcd3-f127783483e3 req-a387e499-fca9-4e06-9b25-1589c0ea33df tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:40:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-4c8a2750-b4b0-4e81-bcd3-f127783483e3 req-a387e499-fca9-4e06-9b25-1589c0ea33df tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2001e5e6-96ae-45e3-ba6f-21e27f07c243', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:40:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-4c8a2750-b4b0-4e81-bcd3-f127783483e3 req-a387e499-fca9-4e06-9b25-1589c0ea33df tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] attachment_update completed successfully. Jul 17 15:40:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-d35c809d-edf3-4c7b-82fa-913f62c42139 req-a9be555f-f3a5-4b22-8611-5bbea3aee88a tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Terminate volume connection completed successfully. Jul 17 15:40:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-d35c809d-edf3-4c7b-82fa-913f62c42139 req-a9be555f-f3a5-4b22-8611-5bbea3aee88a tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Deleting attachment 2001e5e6-96ae-45e3-ba6f-21e27f07c243. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:40:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Acquiring lock "cinder-253fab0e-0ef2-4450-bbaa-823bdda5d0ea-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:40:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "cinder-253fab0e-0ef2-4450-bbaa-823bdda5d0ea-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:40:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Acquiring lock "cinder-quobyte-253fab0e-0ef2-4450-bbaa-823bdda5d0ea" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:40:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "cinder-quobyte-253fab0e-0ef2-4450-bbaa-823bdda5d0ea" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:40:07 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc7369e-6d16-4760-99c7-388225091229]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:40:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:07 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea Jul 17 15:40:07 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:08 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea" returned: 0 in 0.346s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:08 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea Jul 17 15:40:08 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:08 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-253fab0e-0ef2-4450-bbaa-823bdda5d0ea" returned: 0 in 0.257s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "cinder-quobyte-253fab0e-0ef2-4450-bbaa-823bdda5d0ea" released by "delete_volume" :: held 0.648s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Created reservations ['eb18512a-5779-4018-adc7-c7c0321ab476', '946d79bf-7ab2-4150-95ab-6bf1e9f7905e', '310de6e3-5615-45a9-9931-b9d62699cbb4', '2223fe00-ed89-4188-a45b-521981ee58b6'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:08 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:40:08 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:08 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.265s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:40:08 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Deleted volume successfully. Jul 17 15:40:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a5cb6809-3ca1-4e78-89ec-7ff47fb46167 tempest-TestServerVolumeAttachScenarioOldVersion-1693163640 None] Lock "cinder-253fab0e-0ef2-4450-bbaa-823bdda5d0ea-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:40:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:40:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:40:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:40:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:40:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:40:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:40:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:22 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:40:22 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:23 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.324s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:40:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:40:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:40:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:40:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=25,cinder:INSERT=2,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:40:26 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=18,cinder:SELECT=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:40:41 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-d55c5bf4-f050-4147-b797-ee1f97deab9e req-e677229a-bd25-4239-bb93-588d723ca2de tempest-TestMinimumBasicScenario-1492259037 None] Terminate volume connection completed successfully. Jul 17 15:40:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-d55c5bf4-f050-4147-b797-ee1f97deab9e req-e677229a-bd25-4239-bb93-588d723ca2de tempest-TestMinimumBasicScenario-1492259037 None] Deleting attachment 98646955-0fe2-4eff-8e3b-855dc2e2d3e7. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:40:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Acquiring lock "cinder-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:40:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Lock "cinder-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:40:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Acquiring lock "cinder-quobyte-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:40:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Lock "cinder-quobyte-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:40:42 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4602464-952e-491f-bc12-bb6075440486]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:40:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:42 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af Jul 17 15:40:42 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:42 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af" returned: 0 in 0.390s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:42 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af Jul 17 15:40:42 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:43 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af" returned: 0 in 0.244s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Lock "cinder-quobyte-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af" released by "delete_volume" :: held 0.677s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Created reservations ['a4304b94-5028-48bc-a3ca-c1ff06ac34c0', '6648cc90-2a7e-4f38-844c-1cd5938f7dad', '6d1c01e6-fff7-4392-9f7a-996b140b2ec9', '303c90ca-ec77-4d32-bedd-81b19c037c3c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:43 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:40:43 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:43 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:40:43 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Deleted volume successfully. Jul 17 15:40:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-6c047f93-e716-4e22-89e1-ea5130dbf2f9 tempest-TestMinimumBasicScenario-1492259037 None] Lock "cinder-b33ab19a-7cf5-4b4a-b40a-9e22d84a04af-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:40:46 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:40:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Flow 'volume_create_manager' (b0d20403-a03a-4f8f-af78-22756e7e8de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:40:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed9a03c-6b0d-4b68-9515-42d49da9726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed9a03c-6b0d-4b68-9515-42d49da9726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-472109136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466a2aaf-867f-4ea3-838a-1edb6704440b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c9d55c68e340f698578f0deee4a913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:40:47Z,use_quota=True,user_id='d0941814264f4a7995d6e9ff05c0ead5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a23ad86-8bc0-4b38-b404-d3c1f8069c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a23ad86-8bc0-4b38-b404-d3c1f8069c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbbc48b-fa5e-4499-bbe2-1962ccf5a0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:46 devstack cinder-volume[87769]: DEBUG cinder.image.glance [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Creating Keystone auth plugin from conf {{(pid=87769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbbc48b-fa5e-4499-bbe2-1962ccf5a0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '466a2aaf-867f-4ea3-838a-1edb6704440b', 'volume_name': 'volume-466a2aaf-867f-4ea3-838a-1edb6704440b', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33564c1f-a498-42da-b780-8e710dcea77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33564c1f-a498-42da-b780-8e710dcea77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4742468-06a4-4165-a394-ba75097b468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:47 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Volume 466a2aaf-867f-4ea3-838a-1edb6704440b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-466a2aaf-867f-4ea3-838a-1edb6704440b', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Trying to clone 466a2aaf-867f-4ea3-838a-1edb6704440b from image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]). {{(pid=87769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 15:40:47 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Image download 20.69 MB at 20.69 MB/s Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaa8c6a-2406-4c1b-a517-736f33c83a8e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:47 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD Jul 17 15:40:47 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:47 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Temporary image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 is fetched for user d0941814264f4a7995d6e9ff05c0ead5. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c12b8d6-8cf7-42d5-accc-9a105930b197]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:40:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:48 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD Jul 17 15:40:48 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:48 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-472109136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466a2aaf-867f-4ea3-838a-1edb6704440b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c9d55c68e340f698578f0deee4a913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:40:47Z,use_quota=True,user_id='d0941814264f4a7995d6e9ff05c0ead5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Creating volume 466a2aaf-867f-4ea3-838a-1edb6704440b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:40:48 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:48 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b 1073741824 Jul 17 15:40:48 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:48 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b 1073741824" returned: 0 in 0.429s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:48 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b Jul 17 15:40:48 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:49 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b" returned: 0 in 0.261s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Attempting download of 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 ((None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}])) to volume 466a2aaf-867f-4ea3-838a-1edb6704440b. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2827ab0c-e563-456f-b3e0-74d41341fea4]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_6ycdn5gw {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:49 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_6ycdn5gw Jul 17 15:40:49 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:49 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_6ycdn5gw" returned: 0 in 0.363s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_6ycdn5gw {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:49 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_6ycdn5gw Jul 17 15:40:49 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:49 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_6ycdn5gw" returned: 1 in 0.368s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_6ycdn5gw' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe79a2f-2986-4b40-a194-52dd183cbdd9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:40:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:50 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD Jul 17 15:40:50 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:50 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:50 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 was qcow2, converting to qcow2 {{(pid=87769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 15:40:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:50 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b Jul 17 15:40:50 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:51 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b" returned: 0 in 1.746s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:51 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02719de7-bed0-4c37-9f3e-e1a32d4d7a95_99v3vowgdevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:40:51 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Converted 112.00 MB image at 64.10 MB/s Jul 17 15:40:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:40:52 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b 1G Jul 17 15:40:52 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:40:52 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b 1G" returned: 0 in 0.370s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Downloaded image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 ((None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}])) to volume 466a2aaf-867f-4ea3-838a-1edb6704440b successfully. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Temporary image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 for user d0941814264f4a7995d6e9ff05c0ead5 is deleted. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Marking volume 466a2aaf-867f-4ea3-838a-1edb6704440b as bootable. {{(pid=87769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Copying metadata from image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 to 466a2aaf-867f-4ea3-838a-1edb6704440b. {{(pid=87769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Creating volume glance metadata for volume 466a2aaf-867f-4ea3-838a-1edb6704440b backed by image 02719de7-bed0-4c37-9f3e-e1a32d4d7a95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4742468-06a4-4165-a394-ba75097b468b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466a2aaf-867f-4ea3-838a-1edb6704440b', 'volume_size': 1, 'image_id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4bbd11c241440bf92663384c4dadf65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02719de7-bed0-4c37-9f3e-e1a32d4d7a95', 'created_at': datetime.datetime(2026, 7, 17, 13, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02719de7-bed0-4c37-9f3e-e1a32d4d7a95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4ab94e-1781-4795-ae7c-c545d821d2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:40:52 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Volume volume-466a2aaf-867f-4ea3-838a-1edb6704440b (466a2aaf-867f-4ea3-838a-1edb6704440b): created successfully Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4ab94e-1781-4795-ae7c-c545d821d2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:40:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Flow 'volume_create_manager' (b0d20403-a03a-4f8f-af78-22756e7e8de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:40:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e332c490-e0e3-4c8f-a400-6d73feb14170 tempest-TestShelveInstance-1778923842 None] Created volume successfully. Jul 17 15:40:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-141159b2-105a-4cc3-9a8b-daa0fd6a3e0e req-f940d8f5-1969-42f6-896f-fbd0a4522b06 tempest-TestShelveInstance-1778923842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:40:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-141159b2-105a-4cc3-9a8b-daa0fd6a3e0e req-f940d8f5-1969-42f6-896f-fbd0a4522b06 tempest-TestShelveInstance-1778923842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:40:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-141159b2-105a-4cc3-9a8b-daa0fd6a3e0e req-f940d8f5-1969-42f6-896f-fbd0a4522b06 tempest-TestShelveInstance-1778923842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:40:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-141159b2-105a-4cc3-9a8b-daa0fd6a3e0e req-f940d8f5-1969-42f6-896f-fbd0a4522b06 tempest-TestShelveInstance-1778923842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-466a2aaf-867f-4ea3-838a-1edb6704440b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9f53654-ccfe-4ae1-80ef-92e6871d3845', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:40:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-141159b2-105a-4cc3-9a8b-daa0fd6a3e0e req-f940d8f5-1969-42f6-896f-fbd0a4522b06 tempest-TestShelveInstance-1778923842 None] attachment_update completed successfully. Jul 17 15:41:05 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=15 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:41:05 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=22,cinder:UPDATE=13,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Flow 'volume_create_manager' (aaa83214-d42e-47a5-91f6-06194b1d5f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02b4dc4-a4ec-4c29-bc49-afc8cfa74546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02b4dc4-a4ec-4c29-bc49-afc8cfa74546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1961455884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ad2804-f250-4c6b-8bac-7c1c941a93d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95023f808c764d7c9061b3d8167d7f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:41:18Z,use_quota=True,user_id='a74e034cd4a344b5a1f426f3c1a86b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ea387e-a910-472a-8987-f3309499fb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ea387e-a910-472a-8987-f3309499fb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eeb653-cb83-44d0-8b5d-957d1cdb4750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eeb653-cb83-44d0-8b5d-957d1cdb4750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ad2804-f250-4c6b-8bac-7c1c941a93d3', 'volume_name': 'volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0941b13-d80a-4ed7-99ee-8a1cf82b118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0941b13-d80a-4ed7-99ee-8a1cf82b118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6940914c-e0c2-40b6-8a06-d07ac5d0d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Volume 84ad2804-f250-4c6b-8bac-7c1c941a93d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3', 'volume_size': 1} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1961455884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ad2804-f250-4c6b-8bac-7c1c941a93d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95023f808c764d7c9061b3d8167d7f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:41:18Z,use_quota=True,user_id='a74e034cd4a344b5a1f426f3c1a86b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Creating volume 84ad2804-f250-4c6b-8bac-7c1c941a93d3 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:41:18 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:41:18 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 1073741824 Jul 17 15:41:18 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Flow 'volume_create_manager' (af55fa97-4ca7-4e62-a8e2-2ad18d5c42ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d0ebcf-6e59-42a9-a548-c3a53da3fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d0ebcf-6e59-42a9-a548-c3a53da3fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1250527437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95023f808c764d7c9061b3d8167d7f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:41:19Z,use_quota=True,user_id='a74e034cd4a344b5a1f426f3c1a86b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0cf564-acd3-4a1d-96b9-67a684a38579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0cf564-acd3-4a1d-96b9-67a684a38579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3325a0-bdb5-4339-9204-9b81198b27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3325a0-bdb5-4339-9204-9b81198b27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6', 'volume_name': 'volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42c768f-c1ed-4a4a-bf5b-73714def7d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42c768f-c1ed-4a4a-bf5b-73714def7d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2418e0f6-9ab7-4eb8-b6c2-0ebebb7d30a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:18 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Volume 4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6', 'volume_size': 1} Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:41:18 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 17 15:41:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 1073741824" returned: 0 in 0.518s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:41:19 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 Jul 17 15:41:19 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:41:19 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3" returned: 0 in 0.254s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1250527437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95023f808c764d7c9061b3d8167d7f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:41:19Z,use_quota=True,user_id='a74e034cd4a344b5a1f426f3c1a86b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Creating volume 4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:41:19 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6940914c-e0c2-40b6-8a06-d07ac5d0d08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:19 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 1073741824 Jul 17 15:41:19 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bffd04e-538d-462b-b43a-e39a9056933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:19 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Volume volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 (84ad2804-f250-4c6b-8bac-7c1c941a93d3): created successfully Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bffd04e-538d-462b-b43a-e39a9056933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Flow 'volume_create_manager' (aaa83214-d42e-47a5-91f6-06194b1d5f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:41:19 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b785dd1b-3ad1-40ee-9495-0ba6326666fa tempest-TestServerVolumeAttachmentScenario-1630600048 None] Created volume successfully. Jul 17 15:41:19 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 1073741824" returned: 0 in 0.456s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:41:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:41:19 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 Jul 17 15:41:19 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:41:20 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 17 15:41:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6" returned: 0 in 0.261s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:41:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:41:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:41:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2418e0f6-9ab7-4eb8-b6c2-0ebebb7d30a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4909d244-f314-427b-95f5-314280a81491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:41:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Volume volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 (4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6): created successfully Jul 17 15:41:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4909d244-f314-427b-95f5-314280a81491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:41:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Flow 'volume_create_manager' (af55fa97-4ca7-4e62-a8e2-2ad18d5c42ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:41:20 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-dbd16fa2-6ee7-462f-b54c-9c7bea8c248f tempest-TestServerVolumeAttachmentScenario-1630600048 None] Created volume successfully. Jul 17 15:41:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:41:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:41:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:41:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:41:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:41:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:41:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:41:22 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:41:22 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:41:23 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 17 15:41:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.354s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:41:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:41:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:41:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:41:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:41:30 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:41:30 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=9,cinder:SELECT=2,cinder:DELETE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:41:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-9ef17e70-bed5-437f-aca8-96912b5b0e08 req-dad9f0dc-8a2f-4b70-9dc2-b34256609a42 tempest-TestShelveInstance-1778923842 None] Terminate volume connection completed successfully. Jul 17 15:41:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-9ef17e70-bed5-437f-aca8-96912b5b0e08 req-dad9f0dc-8a2f-4b70-9dc2-b34256609a42 tempest-TestShelveInstance-1778923842 None] Deleting attachment a9f53654-ccfe-4ae1-80ef-92e6871d3845. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:41:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-928ae220-866c-492b-8f69-92e65c374a03 req-e06eddba-fe2b-4a13-881a-9dd62dd505e6 tempest-TestShelveInstance-1778923842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:41:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-928ae220-866c-492b-8f69-92e65c374a03 req-e06eddba-fe2b-4a13-881a-9dd62dd505e6 tempest-TestShelveInstance-1778923842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:41:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-928ae220-866c-492b-8f69-92e65c374a03 req-e06eddba-fe2b-4a13-881a-9dd62dd505e6 tempest-TestShelveInstance-1778923842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:41:34 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-928ae220-866c-492b-8f69-92e65c374a03 req-e06eddba-fe2b-4a13-881a-9dd62dd505e6 tempest-TestShelveInstance-1778923842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-466a2aaf-867f-4ea3-838a-1edb6704440b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29813228-5784-4033-b2cb-fd2975342050', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:41:34 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-928ae220-866c-492b-8f69-92e65c374a03 req-e06eddba-fe2b-4a13-881a-9dd62dd505e6 tempest-TestShelveInstance-1778923842 None] attachment_update completed successfully. Jul 17 15:41:44 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:41:44 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:41:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-de44d705-7145-4897-9d44-5cc29183b996 req-d66d366f-4d3f-477d-9bee-7af0db0f93cc tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:41:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-de44d705-7145-4897-9d44-5cc29183b996 req-d66d366f-4d3f-477d-9bee-7af0db0f93cc tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:41:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-de44d705-7145-4897-9d44-5cc29183b996 req-d66d366f-4d3f-477d-9bee-7af0db0f93cc tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:41:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-de44d705-7145-4897-9d44-5cc29183b996 req-d66d366f-4d3f-477d-9bee-7af0db0f93cc tempest-TestServerVolumeAttachmentScenario-1630600048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0a90426-c7fb-42e5-8a73-12942b8fc98a', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:41:50 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-de44d705-7145-4897-9d44-5cc29183b996 req-d66d366f-4d3f-477d-9bee-7af0db0f93cc tempest-TestServerVolumeAttachmentScenario-1630600048 None] attachment_update completed successfully. Jul 17 15:41:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-67f87cd7-dd64-4772-bade-f396f5f37aed req-401dfed6-d095-449d-9078-a60879dd4368 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:41:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-67f87cd7-dd64-4772-bade-f396f5f37aed req-401dfed6-d095-449d-9078-a60879dd4368 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:41:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-67f87cd7-dd64-4772-bade-f396f5f37aed req-401dfed6-d095-449d-9078-a60879dd4368 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:41:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-67f87cd7-dd64-4772-bade-f396f5f37aed req-401dfed6-d095-449d-9078-a60879dd4368 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee1c35a9-6978-4bcf-8077-8610ca98ad74', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:41:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-67f87cd7-dd64-4772-bade-f396f5f37aed req-401dfed6-d095-449d-9078-a60879dd4368 tempest-TestServerVolumeAttachmentScenario-1630600048 None] attachment_update completed successfully. Jul 17 15:41:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-7f3ac499-dafc-425b-a0c8-8ec4e31a9106 req-a71aff7c-08f6-4a97-a881-e601260ef1b8 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Terminate volume connection completed successfully. Jul 17 15:41:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-7f3ac499-dafc-425b-a0c8-8ec4e31a9106 req-a71aff7c-08f6-4a97-a881-e601260ef1b8 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Deleting attachment ee1c35a9-6978-4bcf-8077-8610ca98ad74. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:41:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-ab2c734a-d485-4e96-afd2-6f5053f20df3 req-550e9d7d-79cb-48d7-a483-9922f14887c1 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Terminate volume connection completed successfully. Jul 17 15:41:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-ab2c734a-d485-4e96-afd2-6f5053f20df3 req-550e9d7d-79cb-48d7-a483-9922f14887c1 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Deleting attachment c0a90426-c7fb-42e5-8a73-12942b8fc98a. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:42:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "cinder-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "cinder-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "cinder-quobyte-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "cinder-quobyte-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[795af83e-ff36-42c8-a6c7-94dc915bc13e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:01 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 Jul 17 15:42:01 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:01 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6" returned: 0 in 0.474s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:01 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6 Jul 17 15:42:01 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:02 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6" returned: 0 in 0.319s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "cinder-quobyte-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6" released by "delete_volume" :: held 0.873s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-ab50450b-05e6-4c17-b391-2634539a3139 req-954bfbdc-2fb1-444f-a107-607b9502a2b6 tempest-TestShelveInstance-1778923842 None] Terminate volume connection completed successfully. Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-ab50450b-05e6-4c17-b391-2634539a3139 req-954bfbdc-2fb1-444f-a107-607b9502a2b6 tempest-TestShelveInstance-1778923842 None] Deleting attachment 29813228-5784-4033-b2cb-fd2975342050. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Created reservations ['08a4ad30-3296-4bec-b9d7-76296e5b87f2', '1092fe51-2b3c-45a4-9d9f-74622c61ac0a', '7c7f89e0-349a-443f-b165-69d7d46ee209', '24e4f1e4-4051-4541-bda5-4d025d367a7a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:02 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:02 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Acquiring lock "cinder-466a2aaf-867f-4ea3-838a-1edb6704440b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Lock "cinder-466a2aaf-867f-4ea3-838a-1edb6704440b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Acquiring lock "cinder-quobyte-466a2aaf-867f-4ea3-838a-1edb6704440b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Lock "cinder-quobyte-466a2aaf-867f-4ea3-838a-1edb6704440b" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cfe28a-6528-455a-8fae-62b26430d6c4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:02 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b Jul 17 15:42:02 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:02 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.335s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Deleted volume successfully. Jul 17 15:42:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-03a678f6-5ee1-4627-b7c1-d2a5fcb35635 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "cinder-4c9fc451-3e36-4b5d-9962-6eb6e9ab7ae6-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:03 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b" returned: 0 in 0.417s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:03 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b Jul 17 15:42:03 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:03 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-466a2aaf-867f-4ea3-838a-1edb6704440b" returned: 0 in 0.244s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Lock "cinder-quobyte-466a2aaf-867f-4ea3-838a-1edb6704440b" released by "delete_volume" :: held 0.707s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.quota [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Created reservations ['6c5977ad-24f6-435a-9873-5f5888b81369', '5814bf7c-7b8d-47e6-b1e3-8d8f54fdf867', '5455763c-ac84-4e2f-b553-b711f7f8bd11', '92a0f1c0-ae2a-4306-b6fe-c86eba71fd99'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:03 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:03 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "cinder-84ad2804-f250-4c6b-8bac-7c1c941a93d3-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "cinder-84ad2804-f250-4c6b-8bac-7c1c941a93d3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "cinder-quobyte-84ad2804-f250-4c6b-8bac-7c1c941a93d3" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "cinder-quobyte-84ad2804-f250-4c6b-8bac-7c1c941a93d3" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c231fd-c162-4f75-8a8a-77ad4f12ce94]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:03 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.295s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.manager [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:03 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Deleted volume successfully. Jul 17 15:42:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [req-ab50450b-05e6-4c17-b391-2634539a3139 req-6e4071ed-32dd-41d1-8a36-4160751b8aa2 tempest-TestShelveInstance-1778923842 None] Lock "cinder-466a2aaf-867f-4ea3-838a-1edb6704440b-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:03 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 Jul 17 15:42:03 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:04 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3" returned: 0 in 0.457s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:04 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3 Jul 17 15:42:04 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:04 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-84ad2804-f250-4c6b-8bac-7c1c941a93d3" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "cinder-quobyte-84ad2804-f250-4c6b-8bac-7c1c941a93d3" released by "delete_volume" :: held 0.767s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Created reservations ['aca24010-3cb0-4638-b2f1-be91f624d440', 'cf37ad54-bf75-4705-86b5-0a0dc04ecad5', '8b563c13-0579-405e-af62-52b99abc6826', '0832cd4a-6204-4cf7-9deb-f58148e98a89'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:04 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:04 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:04 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.296s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Deleted volume successfully. Jul 17 15:42:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-10229cd0-4339-48aa-890a-ec07ac1425b7 tempest-TestServerVolumeAttachmentScenario-1630600048 None] Lock "cinder-84ad2804-f250-4c6b-8bac-7c1c941a93d3-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:14 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=36,cinder:UPDATE=28,cinder:INSERT=7 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:42:14 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=26,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (d6f52c96-afdf-46f2-8c2c-653302da1b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81c18e3-038e-4b63-a669-85b2c3d5a73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81c18e3-038e-4b63-a669-85b2c3d5a73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2269422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bf5068-0c12-4308-bd2e-fef4f612513a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:16Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71830397-958e-4177-914e-74a07e926743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71830397-958e-4177-914e-74a07e926743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c24b24-f336-4d1d-ab73-844edbcae556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c24b24-f336-4d1d-ab73-844edbcae556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49bf5068-0c12-4308-bd2e-fef4f612513a', 'volume_name': 'volume-49bf5068-0c12-4308-bd2e-fef4f612513a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9461868a-b41f-456d-9c91-8b6439e0dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9461868a-b41f-456d-9c91-8b6439e0dc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c110a901-f063-4078-b806-a5424b9ec115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:15 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume 49bf5068-0c12-4308-bd2e-fef4f612513a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49bf5068-0c12-4308-bd2e-fef4f612513a', 'volume_size': 1} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2269422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bf5068-0c12-4308-bd2e-fef4f612513a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:16Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Creating volume 49bf5068-0c12-4308-bd2e-fef4f612513a {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:15 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:15 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a 1073741824 Jul 17 15:42:15 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:16 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a 1073741824" returned: 0 in 0.459s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:16 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a Jul 17 15:42:16 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:16 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a" returned: 0 in 0.244s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c110a901-f063-4078-b806-a5424b9ec115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49bf5068-0c12-4308-bd2e-fef4f612513a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046d5144-284c-41cd-883d-d8e2e756b228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:16 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume volume-49bf5068-0c12-4308-bd2e-fef4f612513a (49bf5068-0c12-4308-bd2e-fef4f612513a): created successfully Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046d5144-284c-41cd-883d-d8e2e756b228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (d6f52c96-afdf-46f2-8c2c-653302da1b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-36141768-ad50-4370-b171-1c30051724c2 tempest-CreateVolumesFromSnapshotTest-652421585 None] Created volume successfully. Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Creating offline snapshot 0f0ef99f-a81e-40ac-ae5a-6214223f2870 of volume 49bf5068-0c12-4308-bd2e-fef4f612513a {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:42:17 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a65d5bf-d981-46ad-8837-007614745325]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:17 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a Jul 17 15:42:17 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:17 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a" returned: 0 in 0.364s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:17 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 1G Jul 17 15:42:17 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:17 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 1G" returned: 0 in 0.443s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49bf5068-0c12-4308-bd2e-fef4f612513a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:17 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49bf5068-0c12-4308-bd2e-fef4f612513a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 Jul 17 15:42:17 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:18 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49bf5068-0c12-4308-bd2e-fef4f612513a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870" returned: 0 in 0.302s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:18 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 is being set with open permissions: ugo+rw Jul 17 15:42:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:18 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 Jul 17 15:42:18 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:18 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870" returned: 0 in 0.250s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:18 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.info Jul 17 15:42:18 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:18 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.info" returned: 0 in 0.252s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:18 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.info is being set with open permissions: ugo+rw Jul 17 15:42:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:18 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.info Jul 17 15:42:18 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:18 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.info" returned: 0 in 0.248s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:18 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f66cfb95-9710-4585-849b-fb922adae8a5 tempest-CreateVolumesFromSnapshotTest-652421585 None] Create snapshot completed successfully Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (e6750e16-5732-4bf3-9c15-bdf36b49fe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554a3e74-4660-44eb-9180-f41e059a99e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554a3e74-4660-44eb-9180-f41e059a99e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-188151987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:20Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8c49fc-4748-4b94-9704-518e950589b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8c49fc-4748-4b94-9704-518e950589b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2fa429-664b-4450-8575-44f8b72b64a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2fa429-664b-4450-8575-44f8b72b64a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8', 'volume_name': 'volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b4ce88-da4d-43bf-8ce6-4aa71766ac2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b4ce88-da4d-43bf-8ce6-4aa71766ac2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c331d0ae-3f29-4218-acd7-5d1281cdf708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:19 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8', 'volume_size': 1} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-188151987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:20Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Creating volume f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:19 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:19 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 1073741824 Jul 17 15:42:19 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (8fcbd3d6-154b-4664-9aac-b763aa2ba4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07802c42-818e-4870-bdec-603c64e8f83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07802c42-818e-4870-bdec-603c64e8f83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064833038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f8412d-b9c7-4981-b722-2aca694b66fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:20Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05dbc25-c4e8-4cb6-befd-18262c20caee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05dbc25-c4e8-4cb6-befd-18262c20caee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca1db56-4d32-483a-9e89-4b859f46d859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca1db56-4d32-483a-9e89-4b859f46d859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f8412d-b9c7-4981-b722-2aca694b66fb', 'volume_name': 'volume-e7f8412d-b9c7-4981-b722-2aca694b66fb', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c045a755-e904-4714-8340-cb40d51fe220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c045a755-e904-4714-8340-cb40d51fe220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31c0723-366d-4074-a0bd-2133036b6171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume e7f8412d-b9c7-4981-b722-2aca694b66fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f8412d-b9c7-4981-b722-2aca694b66fb', 'volume_size': 1} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:20 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 1073741824" returned: 0 in 0.668s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:20 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 Jul 17 15:42:20 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (55a3616a-469e-4e0b-a325-7fde866def15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e395ae-856b-4799-b918-21b3bb9bb2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e395ae-856b-4799-b918-21b3bb9bb2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407640204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d0ffd0-2943-4711-aea4-63d557ef38e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:21Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a3d792-5c31-4c76-b454-0eae87ac1d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a3d792-5c31-4c76-b454-0eae87ac1d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece1d753-88b0-49e1-af7b-04b262536ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece1d753-88b0-49e1-af7b-04b262536ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d0ffd0-2943-4711-aea4-63d557ef38e7', 'volume_name': 'volume-49d0ffd0-2943-4711-aea4-63d557ef38e7', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcb48c3-22bd-4e6b-b023-4e4e6d8b4fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcb48c3-22bd-4e6b-b023-4e4e6d8b4fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036efc7e-66a8-44e1-a0e5-0bfd919c1298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume 49d0ffd0-2943-4711-aea4-63d557ef38e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d0ffd0-2943-4711-aea4-63d557ef38e7', 'volume_size': 1} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8" returned: 0 in 0.353s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064833038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f8412d-b9c7-4981-b722-2aca694b66fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:20Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Creating volume e7f8412d-b9c7-4981-b722-2aca694b66fb {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:20 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:20 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb 1073741824 Jul 17 15:42:20 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c331d0ae-3f29-4218-acd7-5d1281cdf708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1706f4-4a80-4eb7-b02c-ea1408e21eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 (f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8): created successfully Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1706f4-4a80-4eb7-b02c-ea1408e21eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (e6750e16-5732-4bf3-9c15-bdf36b49fe8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ad47a951-48bf-4eb2-acff-42faae2dd131 tempest-CreateVolumesFromSnapshotTest-652421585 None] Created volume successfully. Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (033e7fe6-deb2-4d73-87d2-6cf698a8f0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6b565c-6c04-4d1b-bda9-e6dc7511551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6b565c-6c04-4d1b-bda9-e6dc7511551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1930582053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aed5ea5-80c5-4da6-aa53-6315849307e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:21Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cbdfa7-6060-4c60-88e1-18c053b6eaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cbdfa7-6060-4c60-88e1-18c053b6eaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7238c977-d4f2-47d8-8d46-d711be374bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7238c977-d4f2-47d8-8d46-d711be374bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aed5ea5-80c5-4da6-aa53-6315849307e5', 'volume_name': 'volume-0aed5ea5-80c5-4da6-aa53-6315849307e5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d44155f-cc89-45db-a6ae-a836abbf0bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d44155f-cc89-45db-a6ae-a836abbf0bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422fd605-5ee4-4b9b-8dd3-8c1d98d15012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume 0aed5ea5-80c5-4da6-aa53-6315849307e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aed5ea5-80c5-4da6-aa53-6315849307e5', 'volume_size': 1} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:21 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb 1073741824" returned: 0 in 0.652s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:21 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb Jul 17 15:42:21 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (c213290f-3107-4237-b6e2-e1a81c43a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f195e8ec-7e6d-493d-92df-cc330ade554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f195e8ec-7e6d-493d-92df-cc330ade554e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2009965208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:22Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945a3173-2d28-4d37-bb7e-9134ba363ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945a3173-2d28-4d37-bb7e-9134ba363ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d1507e-eaa0-41ef-beac-ffb37af94636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d1507e-eaa0-41ef-beac-ffb37af94636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073', 'volume_name': 'volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8023edf-b071-40ef-98a0-4baa224257ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8023edf-b071-40ef-98a0-4baa224257ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae6d257-ee97-4708-bee6-f4c3f8f59e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume 7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073', 'volume_size': 1} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:21 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb" returned: 0 in 0.275s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407640204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d0ffd0-2943-4711-aea4-63d557ef38e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:21Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Creating volume 49d0ffd0-2943-4711-aea4-63d557ef38e7 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:21 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31c0723-366d-4074-a0bd-2133036b6171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f8412d-b9c7-4981-b722-2aca694b66fb', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859af5e8-a73c-4cfd-b1d5-f5335f01f1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:21 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 1073741824 Jul 17 15:42:21 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume volume-e7f8412d-b9c7-4981-b722-2aca694b66fb (e7f8412d-b9c7-4981-b722-2aca694b66fb): created successfully Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859af5e8-a73c-4cfd-b1d5-f5335f01f1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (8fcbd3d6-154b-4664-9aac-b763aa2ba4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-73ca0922-94b8-4d72-b233-e299f72040fd tempest-CreateVolumesFromSnapshotTest-652421585 None] Created volume successfully. Jul 17 15:42:22 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 1073741824" returned: 0 in 0.492s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:22 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 Jul 17 15:42:22 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:22 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7" returned: 0 in 0.322s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1930582053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aed5ea5-80c5-4da6-aa53-6315849307e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:21Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Creating volume 0aed5ea5-80c5-4da6-aa53-6315849307e5 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:22 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:22 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 1073741824 Jul 17 15:42:22 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036efc7e-66a8-44e1-a0e5-0bfd919c1298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d0ffd0-2943-4711-aea4-63d557ef38e7', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0db2a8-e5eb-4e10-a470-2f82a1795390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:22 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 (49d0ffd0-2943-4711-aea4-63d557ef38e7): created successfully Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0db2a8-e5eb-4e10-a470-2f82a1795390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (55a3616a-469e-4e0b-a325-7fde866def15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:22 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:22 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-40448901-23f8-4df4-96e6-f307a160af41 tempest-CreateVolumesFromSnapshotTest-652421585 None] Created volume successfully. Jul 17 15:42:23 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.318s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:42:23 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 1073741824" returned: 0 in 0.509s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:23 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 Jul 17 15:42:23 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:23 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5" returned: 0 in 0.252s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.841s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2009965208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b3c700481b4edeacf87e4ca7b78ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:22Z,use_quota=True,user_id='c50c998ccd354b3f8f78961bb0de4cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Creating volume 7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:23 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:23 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 1073741824 Jul 17 15:42:23 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422fd605-5ee4-4b9b-8dd3-8c1d98d15012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aed5ea5-80c5-4da6-aa53-6315849307e5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e18a04c-7f09-46b7-8971-a49029705b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:23 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 (0aed5ea5-80c5-4da6-aa53-6315849307e5): created successfully Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e18a04c-7f09-46b7-8971-a49029705b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (033e7fe6-deb2-4d73-87d2-6cf698a8f0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b3ab5b72-bf34-46a2-b44d-060f74bc332c tempest-CreateVolumesFromSnapshotTest-652421585 None] Created volume successfully. Jul 17 15:42:24 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 1073741824" returned: 0 in 0.515s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:24 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 Jul 17 15:42:24 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:24 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073" returned: 0 in 0.256s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae6d257-ee97-4708-bee6-f4c3f8f59e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ede7f5-f9db-4958-abf9-445c9431681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:24 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Volume volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 (7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073): created successfully Jul 17 15:42:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ede7f5-f9db-4958-abf9-445c9431681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Flow 'volume_create_manager' (c213290f-3107-4237-b6e2-e1a81c43a086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-942bad2a-afd6-4bc8-a2c2-34b4713d6039 tempest-CreateVolumesFromSnapshotTest-652421585 None] Created volume successfully. Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-quobyte-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f763736b-fffb-4925-9920-0c5b0361a853]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:25 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 Jul 17 15:42:25 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:25 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073" returned: 0 in 0.381s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:25 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073 Jul 17 15:42:25 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:25 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073" returned: 0 in 0.257s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073" released by "delete_volume" :: held 0.687s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Created reservations ['2ddc8e6d-e495-453f-b7b9-e28b0dfb15ee', 'a26fc031-ae46-4f6a-b9c0-ba95dba8283c', '13e626b1-59f1-4ca2-9314-6b3b2175a34f', '4cb646cd-8e64-4cf0-b2d6-5fc573f04a2d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:25 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:25 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:26 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-0aed5ea5-80c5-4da6-aa53-6315849307e5-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.315s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:26 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Deleted volume successfully. Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-0aed5ea5-80c5-4da6-aa53-6315849307e5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2806958b-db94-4fc8-b229-33fe4f93bccb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-7b3328ef-8fcd-48d0-aad9-b7eb9ff0a073-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-quobyte-0aed5ea5-80c5-4da6-aa53-6315849307e5" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-0aed5ea5-80c5-4da6-aa53-6315849307e5" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dbea56-e71c-4a00-a05c-7ab0eac00bd4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:26 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 Jul 17 15:42:26 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:26 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5" returned: 0 in 0.415s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:26 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5 Jul 17 15:42:26 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:27 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0aed5ea5-80c5-4da6-aa53-6315849307e5" returned: 0 in 0.278s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-0aed5ea5-80c5-4da6-aa53-6315849307e5" released by "delete_volume" :: held 0.737s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Created reservations ['cdfd9df7-af6c-4687-b99d-688854ceb77e', '28d7e0ea-60fa-4e4d-ae70-fa1d049e3741', 'dd93a27f-432b-4e91-be5d-208382cc2bbd', '275c8e08-872a-47b9-827c-31c35e46bb6f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:27 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:27 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-49d0ffd0-2943-4711-aea4-63d557ef38e7-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-49d0ffd0-2943-4711-aea4-63d557ef38e7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:27 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.288s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:27 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Deleted volume successfully. Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-quobyte-49d0ffd0-2943-4711-aea4-63d557ef38e7" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-dbdbbc9b-6c33-4730-99fd-c2fb9eb093eb tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-0aed5ea5-80c5-4da6-aa53-6315849307e5-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-49d0ffd0-2943-4711-aea4-63d557ef38e7" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0077412f-561d-49b3-b7db-5d8ca307944b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:27 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 Jul 17 15:42:27 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:27 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7" returned: 0 in 0.385s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:27 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7 Jul 17 15:42:27 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:28 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49d0ffd0-2943-4711-aea4-63d557ef38e7" returned: 0 in 0.254s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-49d0ffd0-2943-4711-aea4-63d557ef38e7" released by "delete_volume" :: held 0.684s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Created reservations ['6fd08326-60a6-4377-8307-1151c1d3f56c', 'c2e92802-79db-4696-8a1d-277175b266df', 'b710b8fb-d844-4e2a-8aff-92c8a41c14e0', '4d740fc2-d605-4d64-a47d-2891b17ee3b9'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:28 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:28 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:28 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-e7f8412d-b9c7-4981-b722-2aca694b66fb-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.316s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:28 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Deleted volume successfully. Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-e7f8412d-b9c7-4981-b722-2aca694b66fb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbad89d8-0a1e-4044-8582-43a212f24ce6 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-49d0ffd0-2943-4711-aea4-63d557ef38e7-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-quobyte-e7f8412d-b9c7-4981-b722-2aca694b66fb" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-e7f8412d-b9c7-4981-b722-2aca694b66fb" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ca8f4a-cb5b-444a-a5d7-65cdeb50fa24]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:28 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb Jul 17 15:42:28 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:29 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb" returned: 0 in 0.420s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:29 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb Jul 17 15:42:29 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:29 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e7f8412d-b9c7-4981-b722-2aca694b66fb" returned: 0 in 0.255s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-e7f8412d-b9c7-4981-b722-2aca694b66fb" released by "delete_volume" :: held 0.723s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Created reservations ['c4223362-3f93-4a9e-b765-60b38a381efc', '7154356a-5fd8-4007-9821-3f6549ff74b3', '09a58808-eb71-49ac-b108-cf69ce64e431', '9f587f7f-1c07-405a-80e0-8f1675998e9b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:29 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:29 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-quobyte-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:30 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.353s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:30 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Deleted volume successfully. Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7afc84-c5ac-4a76-baf6-7cdf1b9aee65]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-95479efe-32e6-4960-8c27-7933a7a3e333 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-e7f8412d-b9c7-4981-b722-2aca694b66fb-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:30 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 Jul 17 15:42:30 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:30 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8" returned: 0 in 0.380s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:30 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8 Jul 17 15:42:30 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:30 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8" returned: 0 in 0.292s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8" released by "delete_volume" :: held 0.728s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Created reservations ['c28e57fa-0de6-47ee-9703-92893b19f467', '95d9af7b-9a80-48e8-9008-17628b2f2973', '04bb58ee-bd7f-4a62-b16f-9bc688b99345', '60c59c62-ded5-4820-b967-5daadaaad9c6'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:30 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:30 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-0f0ef99f-a81e-40ac-ae5a-6214223f2870-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-0f0ef99f-a81e-40ac-ae5a-6214223f2870-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-quobyte-49bf5068-0c12-4308-bd2e-fef4f612513a" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-49bf5068-0c12-4308-bd2e-fef4f612513a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-quobyte-0f0ef99f-a81e-40ac-ae5a-6214223f2870" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:31 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-0f0ef99f-a81e-40ac-ae5a-6214223f2870" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Deleting offline snapshot 0f0ef99f-a81e-40ac-ae5a-6214223f2870 of volume 49bf5068-0c12-4308-bd2e-fef4f612513a {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] snapshot_file for this snap is: volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.284s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:31 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Deleted volume successfully. Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e748e9-5894-446e-be72-6345937c4603]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5fef523a-2d57-4a03-88e4-ea635be07001 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-f57231c9-d3a7-4caf-a5e2-8bee5b21a6a8-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:31 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 Jul 17 15:42:31 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:31 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870" returned: 0 in 0.385s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49bf5068-0c12-4308-bd2e-fef4f612513a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0d1972-f76e-44df-8bec-c1598d5b5db6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:31 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a Jul 17 15:42:31 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:32 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a" returned: 0 in 0.477s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:32 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 Jul 17 15:42:32 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:32 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870" returned: 0 in 0.346s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:32 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870 Jul 17 15:42:32 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:32 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a.0f0ef99f-a81e-40ac-ae5a-6214223f2870" returned: 0 in 0.254s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-0f0ef99f-a81e-40ac-ae5a-6214223f2870" released by "_delete_snapshot" :: held 1.594s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-49bf5068-0c12-4308-bd2e-fef4f612513a" released by "delete_snapshot" :: held 1.622s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:32 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Created reservations ['00933e58-49e6-4d18-b318-93f94a402918', '0864836d-4118-44e9-b538-b100f739813d', '45ac8cc5-f957-4377-bf50-38f7712f0351', '6f6e917c-3754-48f4-ac67-0f8cd9c0bdda'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Delete snapshot completed successfully. Jul 17 15:42:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0d80ee12-cff2-42c9-bd74-6fc8afaeae03 tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-0f0ef99f-a81e-40ac-ae5a-6214223f2870-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-49bf5068-0c12-4308-bd2e-fef4f612513a-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-49bf5068-0c12-4308-bd2e-fef4f612513a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "cinder-quobyte-49bf5068-0c12-4308-bd2e-fef4f612513a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-49bf5068-0c12-4308-bd2e-fef4f612513a" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:33 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4373128d-aedf-448d-b58a-4656ee171454]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:33 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a Jul 17 15:42:33 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:33 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a" returned: 0 in 0.384s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:33 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a Jul 17 15:42:33 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:34 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49bf5068-0c12-4308-bd2e-fef4f612513a" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-quobyte-49bf5068-0c12-4308-bd2e-fef4f612513a" released by "delete_volume" :: held 0.736s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Created reservations ['0ceb0b57-f853-438e-aea7-6d10b32c7e33', 'c4cc8f42-bc0f-4684-ad43-13b2d3ef065d', '08387e39-9d00-4ce6-a733-85e298de175c', '1d673236-0f81-472b-a5e9-58e8414e9959'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:34 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:34 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:34 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.252s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:34 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Deleted volume successfully. Jul 17 15:42:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bbd95f05-8425-46c6-a6bb-c922202a623c tempest-CreateVolumesFromSnapshotTest-652421585 None] Lock "cinder-49bf5068-0c12-4308-bd2e-fef4f612513a-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:39 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Flow 'volume_create_manager' (56959089-9d87-4775-bf67-8c6f7667eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da69ddfc-ef97-4ad7-b332-77044879cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da69ddfc-ef97-4ad7-b332-77044879cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df90162-dc51-4669-af97-7b55eaa8acf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ecc9a267e094f2d8cb45b21d5ed88d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:40Z,use_quota=True,user_id='923b3059c4424fdc95d4bdc72b494fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7eac9a2-f0ad-448c-8698-94afaba16f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7eac9a2-f0ad-448c-8698-94afaba16f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81247ee5-801f-446f-b539-43fae5279a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:39 devstack cinder-volume[87769]: DEBUG cinder.image.glance [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Creating Keystone auth plugin from conf {{(pid=87769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81247ee5-801f-446f-b539-43fae5279a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2df90162-dc51-4669-af97-7b55eaa8acf9', 'volume_name': 'volume-2df90162-dc51-4669-af97-7b55eaa8acf9', 'volume_size': 1, 'image_id': '376d03b5-7e03-43a8-9292-18498a54a026', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/376d03b5-7e03-43a8-9292-18498a54a026', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1093d013a411407a9281b6f276dbf543', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ecc9a267e094f2d8cb45b21d5ed88d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de76a89ea9cc6618f930669c404a353943fb948c23b5c505d5431d96eec9e3fae1ad71740959fd1a2db8529a03d6ec80b042f049b9c2b2f0c89f7517a969f96b', 'id': '376d03b5-7e03-43a8-9292-18498a54a026', 'created_at': datetime.datetime(2026, 7, 17, 13, 42, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/376d03b5-7e03-43a8-9292-18498a54a026/file', 'properties': {}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9076e743-9814-48de-8c4d-978995b7e024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9076e743-9814-48de-8c4d-978995b7e024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d185d35-e866-46d8-8464-0623d2061c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:40 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Volume 2df90162-dc51-4669-af97-7b55eaa8acf9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2df90162-dc51-4669-af97-7b55eaa8acf9', 'volume_size': 1, 'image_id': '376d03b5-7e03-43a8-9292-18498a54a026', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/376d03b5-7e03-43a8-9292-18498a54a026', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1093d013a411407a9281b6f276dbf543', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ecc9a267e094f2d8cb45b21d5ed88d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de76a89ea9cc6618f930669c404a353943fb948c23b5c505d5431d96eec9e3fae1ad71740959fd1a2db8529a03d6ec80b042f049b9c2b2f0c89f7517a969f96b', 'id': '376d03b5-7e03-43a8-9292-18498a54a026', 'created_at': datetime.datetime(2026, 7, 17, 13, 42, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/376d03b5-7e03-43a8-9292-18498a54a026/file', 'properties': {}}, 'image_service': } Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Trying to clone 2df90162-dc51-4669-af97-7b55eaa8acf9 from image 376d03b5-7e03-43a8-9292-18498a54a026 at location (None, [{'url': 'file:///opt/stack/data/glance/images/376d03b5-7e03-43a8-9292-18498a54a026', 'metadata': {}}]). {{(pid=87769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 15:42:40 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Image download 0.00 MB at 0.00 MB/s Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad8770-39e3-4a15-a982-58262fdb6e99]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:40 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD Jul 17 15:42:40 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:40 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:40 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD Jul 17 15:42:40 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:40 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Flow 'volume_create_manager' (aed5cfcf-7fd8-4553-bd09-385fa4a2533d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9845657c-747c-4057-8085-a2948d62269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9845657c-747c-4057-8085-a2948d62269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1151737232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b87f48f-e42a-4e89-8a24-1c1d9d28d802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d430ee692c9412e8fdd14c64d0790b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:41Z,use_quota=True,user_id='defddb4310704dd5840a4562f887de3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:41 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059f9f4b-ce26-4ab8-9a9e-f20421f25a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059f9f4b-ce26-4ab8-9a9e-f20421f25a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa22806c-1746-49b2-be71-2eb26d2b4245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa22806c-1746-49b2-be71-2eb26d2b4245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b87f48f-e42a-4e89-8a24-1c1d9d28d802', 'volume_name': 'volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2235f760-ceef-46b0-bac4-5540ec1a2c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2235f760-ceef-46b0-bac4-5540ec1a2c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58748344-55c3-4c5e-8e43-e7a2287236e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:41 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Volume 3b87f48f-e42a-4e89-8a24-1c1d9d28d802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802', 'volume_size': 1} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1151737232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b87f48f-e42a-4e89-8a24-1c1d9d28d802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d430ee692c9412e8fdd14c64d0790b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:41Z,use_quota=True,user_id='defddb4310704dd5840a4562f887de3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Creating volume 3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:41 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD" returned: 1 in 0.430s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Temporary image 376d03b5-7e03-43a8-9292-18498a54a026 is fetched for user 923b3059c4424fdc95d4bdc72b494fff. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 15:42:41 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 1073741824 Jul 17 15:42:41 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e19842-f8d5-435f-905d-24be53418337]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:41 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD Jul 17 15:42:41 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:41 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 1073741824" returned: 0 in 0.423s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:41 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:41 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 Jul 17 15:42:41 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:41 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD Jul 17 15:42:41 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:41 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58748344-55c3-4c5e-8e43-e7a2287236e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bb84a9-bdb8-4dde-b7d6-70b0d630a196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:41 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Volume volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 (3b87f48f-e42a-4e89-8a24-1c1d9d28d802): created successfully Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bb84a9-bdb8-4dde-b7d6-70b0d630a196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Flow 'volume_create_manager' (aed5cfcf-7fd8-4553-bd09-385fa4a2533d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:41 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6b56cd8f-3c87-41a2-906b-2284248defaa tempest-TestStampPattern-513760373 None] Created volume successfully. Jul 17 15:42:41 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df90162-dc51-4669-af97-7b55eaa8acf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ecc9a267e094f2d8cb45b21d5ed88d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:40Z,use_quota=True,user_id='923b3059c4424fdc95d4bdc72b494fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Creating volume 2df90162-dc51-4669-af97-7b55eaa8acf9 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:41 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:42 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 1073741824 Jul 17 15:42:42 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:42 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 1073741824" returned: 0 in 0.455s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:42 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 Jul 17 15:42:42 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:42 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:42 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Attempting download of 376d03b5-7e03-43a8-9292-18498a54a026 ((None, [{'url': 'file:///opt/stack/data/glance/images/376d03b5-7e03-43a8-9292-18498a54a026', 'metadata': {}}])) to volume 2df90162-dc51-4669-af97-7b55eaa8acf9. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 15:42:42 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e748ce67-860e-4e7e-9fc0-1c500caa3542]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_376d03b5-7e03-43a8-9292-18498a54a026_5lsxy3ts {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:42 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_376d03b5-7e03-43a8-9292-18498a54a026_5lsxy3ts Jul 17 15:42:42 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:43 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_376d03b5-7e03-43a8-9292-18498a54a026_5lsxy3ts" returned: 0 in 0.397s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_376d03b5-7e03-43a8-9292-18498a54a026_5lsxy3ts {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:43 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_376d03b5-7e03-43a8-9292-18498a54a026_5lsxy3ts Jul 17 15:42:43 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:43 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_376d03b5-7e03-43a8-9292-18498a54a026_5lsxy3ts" returned: 1 in 0.358s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_376d03b5-7e03-43a8-9292-18498a54a026_5lsxy3ts' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:42:43 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc32781b-421f-4d72-abd6-f941a118636c]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:43 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD Jul 17 15:42:43 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:43 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:44 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD Jul 17 15:42:44 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:44 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD" returned: 1 in 0.420s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:42:44 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] 376d03b5-7e03-43a8-9292-18498a54a026 was raw, converting to qcow2 {{(pid=87769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 15:42:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:44 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 Jul 17 15:42:44 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:44 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9" returned: 0 in 0.460s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:44 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_376d03b5-7e03-43a8-9292-18498a54a026_nhqred11devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:42:44 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 15:42:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:44 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 1G Jul 17 15:42:44 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:45 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 1G" returned: 0 in 0.355s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Downloaded image 376d03b5-7e03-43a8-9292-18498a54a026 ((None, [{'url': 'file:///opt/stack/data/glance/images/376d03b5-7e03-43a8-9292-18498a54a026', 'metadata': {}}])) to volume 2df90162-dc51-4669-af97-7b55eaa8acf9 successfully. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Temporary image 376d03b5-7e03-43a8-9292-18498a54a026 for user 923b3059c4424fdc95d4bdc72b494fff is deleted. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Marking volume 2df90162-dc51-4669-af97-7b55eaa8acf9 as bootable. {{(pid=87769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Copying metadata from image 376d03b5-7e03-43a8-9292-18498a54a026 to 2df90162-dc51-4669-af97-7b55eaa8acf9. {{(pid=87769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Creating volume glance metadata for volume 2df90162-dc51-4669-af97-7b55eaa8acf9 backed by image 376d03b5-7e03-43a8-9292-18498a54a026 with: {'image_id': '376d03b5-7e03-43a8-9292-18498a54a026', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1093d013a411407a9281b6f276dbf543', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d185d35-e866-46d8-8464-0623d2061c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df90162-dc51-4669-af97-7b55eaa8acf9', 'volume_size': 1, 'image_id': '376d03b5-7e03-43a8-9292-18498a54a026', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/376d03b5-7e03-43a8-9292-18498a54a026', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1093d013a411407a9281b6f276dbf543', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ecc9a267e094f2d8cb45b21d5ed88d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de76a89ea9cc6618f930669c404a353943fb948c23b5c505d5431d96eec9e3fae1ad71740959fd1a2db8529a03d6ec80b042f049b9c2b2f0c89f7517a969f96b', 'id': '376d03b5-7e03-43a8-9292-18498a54a026', 'created_at': datetime.datetime(2026, 7, 17, 13, 42, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/376d03b5-7e03-43a8-9292-18498a54a026/file', 'properties': {}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b4d027-2a8c-4928-991c-2b0a44c04821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Volume volume-2df90162-dc51-4669-af97-7b55eaa8acf9 (2df90162-dc51-4669-af97-7b55eaa8acf9): created successfully Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b4d027-2a8c-4928-991c-2b0a44c04821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Flow 'volume_create_manager' (56959089-9d87-4775-bf67-8c6f7667eb83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a0f33ac8-ac5b-4b8c-a2e7-2c8aa55e1bdd tempest-VolumeImageDependencyTests-1331979123 None] Created volume successfully. Jul 17 15:42:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Acquiring lock "cinder-2df90162-dc51-4669-af97-7b55eaa8acf9-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Lock "cinder-2df90162-dc51-4669-af97-7b55eaa8acf9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Acquiring lock "cinder-quobyte-2df90162-dc51-4669-af97-7b55eaa8acf9" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Lock "cinder-quobyte-2df90162-dc51-4669-af97-7b55eaa8acf9" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:46 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a092a2-2fb6-4ff7-ae90-a8471967945e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:47 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 Jul 17 15:42:47 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:47 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9" returned: 0 in 0.575s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:47 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9 Jul 17 15:42:47 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:47 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2df90162-dc51-4669-af97-7b55eaa8acf9" returned: 0 in 0.268s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Lock "cinder-quobyte-2df90162-dc51-4669-af97-7b55eaa8acf9" released by "delete_volume" :: held 0.923s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Created reservations ['90223ffb-2b7a-4a5c-843c-abd57d18b0da', '304f5e70-79ea-43f4-b206-636fc53b034c', '44f0dee8-a8a0-48ce-b602-f2d41f08008a', '37a85656-d140-4f5c-be5d-64b8cda4af3f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:47 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:42:47 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:48 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.273s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:48 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:42:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Deleted volume successfully. Jul 17 15:42:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a18644be-057d-45d2-8c03-1ee2b0d8ac15 tempest-VolumeImageDependencyTests-1331979123 None] Lock "cinder-2df90162-dc51-4669-af97-7b55eaa8acf9-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Flow 'volume_create_manager' (891255da-ce5c-4d87-8ea8-102e986a4e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc02d9ac-24a6-427a-99f1-8545e0cdc3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc02d9ac-24a6-427a-99f1-8545e0cdc3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eae1ad4-6256-4cf6-8ee6-294de9b123b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8bb772ab2224ceb82761ed57c9036f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:52Z,use_quota=True,user_id='510b06207fa648adbbbaffaab4c43160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126cfe09-aaca-4406-be60-e5e458f3e1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126cfe09-aaca-4406-be60-e5e458f3e1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8988dcb1-354e-48b3-a2b7-1cb47c8397ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8988dcb1-354e-48b3-a2b7-1cb47c8397ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eae1ad4-6256-4cf6-8ee6-294de9b123b0', 'volume_name': 'volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edabf172-61ae-43c7-8b2a-5cd52f81216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edabf172-61ae-43c7-8b2a-5cd52f81216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8c7714-768d-425d-baaa-4023381638bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:52 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Volume 0eae1ad4-6256-4cf6-8ee6-294de9b123b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0', 'volume_size': 1} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eae1ad4-6256-4cf6-8ee6-294de9b123b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8bb772ab2224ceb82761ed57c9036f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:52Z,use_quota=True,user_id='510b06207fa648adbbbaffaab4c43160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Creating volume 0eae1ad4-6256-4cf6-8ee6-294de9b123b0 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:52 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:52 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 1073741824 Jul 17 15:42:52 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:52 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 1073741824" returned: 0 in 0.422s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:52 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 Jul 17 15:42:52 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:53 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0" returned: 0 in 0.267s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8c7714-768d-425d-baaa-4023381638bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f618e9-5e72-446a-93ee-01e42ef7ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:53 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Volume volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 (0eae1ad4-6256-4cf6-8ee6-294de9b123b0): created successfully Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f618e9-5e72-446a-93ee-01e42ef7ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Flow 'volume_create_manager' (891255da-ce5c-4d87-8ea8-102e986a4e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d0265aba-9190-4c63-b63a-b77115e3e965 tempest-CinderUnicodeTest-1886081337 None] Created volume successfully. Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Flow 'volume_create_manager' (9e325162-44d9-48c2-a730-7335c1c42bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852f25ac-1b58-4c42-9e2d-b2cd20550b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852f25ac-1b58-4c42-9e2d-b2cd20550b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-114062539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75db46a-4604-4b98-8f35-375503662452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8bb772ab2224ceb82761ed57c9036f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:54Z,use_quota=True,user_id='510b06207fa648adbbbaffaab4c43160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d2c4f7-789e-44e9-a10b-b01e6960e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d2c4f7-789e-44e9-a10b-b01e6960e46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8ff61d-8b09-49b2-b415-48894a9733b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8ff61d-8b09-49b2-b415-48894a9733b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75db46a-4604-4b98-8f35-375503662452', 'volume_name': 'volume-d75db46a-4604-4b98-8f35-375503662452', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8255e3ba-e261-4e5f-8453-8f898f28fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8255e3ba-e261-4e5f-8453-8f898f28fe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657b79d6-0467-4dea-b489-6fe3d4a8ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:53 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Volume d75db46a-4604-4b98-8f35-375503662452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75db46a-4604-4b98-8f35-375503662452', 'volume_size': 1} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:42:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-114062539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75db46a-4604-4b98-8f35-375503662452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8bb772ab2224ceb82761ed57c9036f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:42:54Z,use_quota=True,user_id='510b06207fa648adbbbaffaab4c43160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Creating volume d75db46a-4604-4b98-8f35-375503662452 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:42:53 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:42:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:54 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 1073741824 Jul 17 15:42:54 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:54 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 1073741824" returned: 0 in 0.416s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:54 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 Jul 17 15:42:54 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:54 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452" returned: 0 in 0.241s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:42:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657b79d6-0467-4dea-b489-6fe3d4a8ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75db46a-4604-4b98-8f35-375503662452', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e822093-9210-47df-8a5a-d48f480db0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:42:54 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Volume volume-d75db46a-4604-4b98-8f35-375503662452 (d75db46a-4604-4b98-8f35-375503662452): created successfully Jul 17 15:42:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e822093-9210-47df-8a5a-d48f480db0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:42:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Flow 'volume_create_manager' (9e325162-44d9-48c2-a730-7335c1c42bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:42:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-354247d5-0fcc-4453-b6ee-6d3cfa62e7ef tempest-CinderUnicodeTest-1886081337 None] Created volume successfully. Jul 17 15:42:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:42:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:42:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Creating offline snapshot d3dd952c-a6f0-4d00-a6bb-08cde1f5efad of volume d75db46a-4604-4b98-8f35-375503662452 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:42:55 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[213cffb9-f2db-4eec-ace4-0549ca8eb87d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:55 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 Jul 17 15:42:55 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:55 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452" returned: 0 in 0.361s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:55 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad 1G Jul 17 15:42:55 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:56 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad 1G" returned: 0 in 0.409s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d75db46a-4604-4b98-8f35-375503662452 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:56 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d75db46a-4604-4b98-8f35-375503662452 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad Jul 17 15:42:56 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:56 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d75db46a-4604-4b98-8f35-375503662452 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad" returned: 0 in 0.295s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:56 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad is being set with open permissions: ugo+rw Jul 17 15:42:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:56 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad Jul 17 15:42:56 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:56 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad" returned: 0 in 0.251s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:56 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.info Jul 17 15:42:56 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:57 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.info" returned: 0 in 0.263s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:57 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.info is being set with open permissions: ugo+rw Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:57 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.info Jul 17 15:42:57 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:57 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.info" returned: 0 in 0.249s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:42:57 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a4f51526-aa87-4d2c-bc93-45804cb39c40 tempest-CinderUnicodeTest-1886081337 None] Create snapshot completed successfully Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "cinder-d3dd952c-a6f0-4d00-a6bb-08cde1f5efad-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-d3dd952c-a6f0-4d00-a6bb-08cde1f5efad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "cinder-quobyte-d75db46a-4604-4b98-8f35-375503662452" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-quobyte-d75db46a-4604-4b98-8f35-375503662452" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "cinder-quobyte-d3dd952c-a6f0-4d00-a6bb-08cde1f5efad" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-quobyte-d3dd952c-a6f0-4d00-a6bb-08cde1f5efad" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Deleting offline snapshot d3dd952c-a6f0-4d00-a6bb-08cde1f5efad of volume d75db46a-4604-4b98-8f35-375503662452 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] snapshot_file for this snap is: volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0a30d2-6f61-43f6-8e1f-09cf701ac336]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:57 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad Jul 17 15:42:57 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:58 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad" returned: 0 in 0.389s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d75db46a-4604-4b98-8f35-375503662452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:42:58 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e4daee-9739-4607-a2f3-ca63c77bb282]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:58 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 Jul 17 15:42:58 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:58 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452" returned: 0 in 0.359s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:58 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad Jul 17 15:42:58 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:58 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:58 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad Jul 17 15:42:58 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:42:59 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452.d3dd952c-a6f0-4d00-a6bb-08cde1f5efad" returned: 0 in 0.266s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-quobyte-d3dd952c-a6f0-4d00-a6bb-08cde1f5efad" released by "_delete_snapshot" :: held 1.467s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-quobyte-d75db46a-4604-4b98-8f35-375503662452" released by "delete_snapshot" :: held 1.490s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Created reservations ['dba9e911-6695-4fc0-8866-1244e651d6f6', 'e7ef1683-bae2-49b4-bf42-0a784c6ee658', '83d570d7-5d85-40e1-a4a8-b788491c3916', '4f54eb1f-cbc1-4920-8ee7-446ce7d4be91'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:42:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Delete snapshot completed successfully. Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9bb57da8-6abd-4c6b-8fdc-7a58ac3d2967 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-d3dd952c-a6f0-4d00-a6bb-08cde1f5efad-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "cinder-d75db46a-4604-4b98-8f35-375503662452-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-d75db46a-4604-4b98-8f35-375503662452-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "cinder-quobyte-d75db46a-4604-4b98-8f35-375503662452" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-quobyte-d75db46a-4604-4b98-8f35-375503662452" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5116418-fc9b-4cd7-81dd-55a270358665]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:42:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:42:59 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 Jul 17 15:42:59 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:00 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452" returned: 0 in 0.370s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:00 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452 Jul 17 15:43:00 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:00 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d75db46a-4604-4b98-8f35-375503662452" returned: 0 in 0.249s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-quobyte-d75db46a-4604-4b98-8f35-375503662452" released by "delete_volume" :: held 0.692s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Created reservations ['015f02e5-b83e-48b2-9a34-4b2ca3666f64', '21ce837d-01d4-4d64-a470-94835044d806', '02028169-416b-49a7-a3a6-ac4728ac0baf', 'f55e68a0-23b7-4fb7-a402-14ba7549edec'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:00 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:43:00 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:00 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.257s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:43:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Deleted volume successfully. Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "cinder-0eae1ad4-6256-4cf6-8ee6-294de9b123b0-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3921e724-5988-47bc-8342-9786ee0bea21 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-d75db46a-4604-4b98-8f35-375503662452-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-0eae1ad4-6256-4cf6-8ee6-294de9b123b0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "cinder-quobyte-0eae1ad4-6256-4cf6-8ee6-294de9b123b0" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-quobyte-0eae1ad4-6256-4cf6-8ee6-294de9b123b0" acquired by "delete_volume" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8008e5da-c0b9-4d47-98c9-871b07e9847f]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:43:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:01 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 Jul 17 15:43:01 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:01 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0" returned: 0 in 0.362s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:01 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0 Jul 17 15:43:01 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:01 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0eae1ad4-6256-4cf6-8ee6-294de9b123b0" returned: 0 in 0.255s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-quobyte-0eae1ad4-6256-4cf6-8ee6-294de9b123b0" released by "delete_volume" :: held 0.655s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Created reservations ['8ba1f7e3-ae36-4a37-88b9-75c7bed0083c', '7e26b044-6eb3-4c25-b3f4-68478c201ce5', '3489b0da-f7c5-4de7-8e1b-42fb6a03f0d7', 'a7753aed-a421-4f33-b3f3-d8d439294482'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:01 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:43:01 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:01 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.269s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:01 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:43:01 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Deleted volume successfully. Jul 17 15:43:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e1ba617b-2f63-4adb-b6ad-2b17e093f465 tempest-CinderUnicodeTest-1886081337 None] Lock "cinder-0eae1ad4-6256-4cf6-8ee6-294de9b123b0-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:43:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-aa3d0c47-284d-4a3f-a274-2ba374c0d452 req-6024a783-1b06-47c2-97ce-a72c24f3e8dd tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:43:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-aa3d0c47-284d-4a3f-a274-2ba374c0d452 req-6024a783-1b06-47c2-97ce-a72c24f3e8dd tempest-TestStampPattern-513760373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:43:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-aa3d0c47-284d-4a3f-a274-2ba374c0d452 req-6024a783-1b06-47c2-97ce-a72c24f3e8dd tempest-TestStampPattern-513760373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:43:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-aa3d0c47-284d-4a3f-a274-2ba374c0d452 req-6024a783-1b06-47c2-97ce-a72c24f3e8dd tempest-TestStampPattern-513760373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08662c07-8881-4641-bad5-63aca1aca48f', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:43:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-aa3d0c47-284d-4a3f-a274-2ba374c0d452 req-6024a783-1b06-47c2-97ce-a72c24f3e8dd tempest-TestStampPattern-513760373 None] attachment_update completed successfully. Jul 17 15:43:15 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=94,cinder:UPDATE=125,cinder:DELETE=13,cinder:INSERT=28 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:43:15 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=114,cinder:SELECT=99,cinder:INSERT=37,cinder:DELETE=8 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:43:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-2927dc47-4488-48df-8d8e-39cb943f29b8 req-b61076fb-107f-44f0-85c9-f548d5e66766 tempest-TestStampPattern-513760373 None] Terminate volume connection completed successfully. Jul 17 15:43:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-2927dc47-4488-48df-8d8e-39cb943f29b8 req-b61076fb-107f-44f0-85c9-f548d5e66766 tempest-TestStampPattern-513760373 None] Deleting attachment 08662c07-8881-4641-bad5-63aca1aca48f. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:43:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:43:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:43:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Creating offline snapshot fb11c954-c5c3-4267-895e-6c74774102cd of volume 3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:43:16 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4434f7-67ac-4210-8c6a-1aadc776bc04]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:43:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:16 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 Jul 17 15:43:16 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:16 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" returned: 0 in 0.363s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:16 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd 1G Jul 17 15:43:16 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:17 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd 1G" returned: 0 in 0.391s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:17 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd Jul 17 15:43:17 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:17 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd" returned: 0 in 0.286s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:17 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd is being set with open permissions: ugo+rw Jul 17 15:43:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:17 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd Jul 17 15:43:17 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:17 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd" returned: 0 in 0.245s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:17 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.info Jul 17 15:43:17 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:18 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.info" returned: 0 in 0.276s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:18 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.info is being set with open permissions: ugo+rw Jul 17 15:43:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:18 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.info Jul 17 15:43:18 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:18 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.info" returned: 0 in 0.237s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:43:18 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9f28f47a-79a5-40db-b4ef-1ec42edeb0d8 tempest-TestStampPattern-513760373 None] Create snapshot completed successfully Jul 17 15:43:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:43:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:43:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:43:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:43:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:43:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:43:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:22 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:43:22 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:23 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.270s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:43:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:43:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:43:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Flow 'volume_create_manager' (47705959-eaf6-4ccb-ad27-f87e37ba6918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed727f5a-e3fa-4986-8462-b65a00def751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed727f5a-e3fa-4986-8462-b65a00def751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1853502580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c093c7-a796-4a06-a544-6f2713b87de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d430ee692c9412e8fdd14c64d0790b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb11c954-c5c3-4267-895e-6c74774102cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:43:25Z,use_quota=True,user_id='defddb4310704dd5840a4562f887de3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbb5733-38ab-49b6-9bc1-7e91743f81e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbb5733-38ab-49b6-9bc1-7e91743f81e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dd71ef-7be6-49a1-a23b-f5cea242ecb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dd71ef-7be6-49a1-a23b-f5cea242ecb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5c093c7-a796-4a06-a544-6f2713b87de0', 'volume_name': 'volume-a5c093c7-a796-4a06-a544-6f2713b87de0', 'volume_size': 1, 'snapshot_id': 'fb11c954-c5c3-4267-895e-6c74774102cd'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5825e460-4c38-4e1c-8060-0825f97e13e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5825e460-4c38-4e1c-8060-0825f97e13e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8593fd64-4850-453e-9c72-80df8e006a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:43:25 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Volume a5c093c7-a796-4a06-a544-6f2713b87de0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5c093c7-a796-4a06-a544-6f2713b87de0', 'volume_size': 1, 'snapshot_id': 'fb11c954-c5c3-4267-895e-6c74774102cd'} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Acquiring lock "cinder-quobyte-fb11c954-c5c3-4267-895e-6c74774102cd-a5c093c7-a796-4a06-a544-6f2713b87de0" by "_create_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-fb11c954-c5c3-4267-895e-6c74774102cd-a5c093c7-a796-4a06-a544-6f2713b87de0" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Creating volume a5c093c7-a796-4a06-a544-6f2713b87de0 from snapshot fb11c954-c5c3-4267-895e-6c74774102cd {{(pid=87769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Acquiring lock "cinder-quobyte-a5c093c7-a796-4a06-a544-6f2713b87de0" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-a5c093c7-a796-4a06-a544-6f2713b87de0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] snapshot: fb11c954-c5c3-4267-895e-6c74774102cd, volume: a5c093c7-a796-4a06-a544-6f2713b87de0, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc91289-25ae-4ffd-ac86-d86a788a6f0b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:25 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd Jul 17 15:43:25 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:25 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd" returned: 0 in 0.370s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ff131d-9300-4087-a586-8a45a5b6260e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:43:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:25 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 Jul 17 15:43:25 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:26 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" returned: 0 in 0.395s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:26 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:43:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:26 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 Jul 17 15:43:26 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:31 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0" returned: 0 in 5.743s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e94cf02-bb3c-4e59-9d26-0a7f8c96bf95]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:43:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:32 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 Jul 17 15:43:32 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:32 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" returned: 0 in 0.718s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:32 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:43:32 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Converted 1024.00 MB image at 178.25 MB/s Jul 17 15:43:32 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 is being set with open permissions: ugo+rw Jul 17 15:43:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:43:32 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 Jul 17 15:43:32 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:43:32 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Jul 17 15:43:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0" returned: 0 in 0.278s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:43:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-a5c093c7-a796-4a06-a544-6f2713b87de0" released by "_copy_volume_from_snapshot" :: held 7.617s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:43:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-fb11c954-c5c3-4267-895e-6c74774102cd-a5c093c7-a796-4a06-a544-6f2713b87de0" released by "_create_volume_from_snapshot" :: held 7.655s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:43:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.673s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:43:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8593fd64-4850-453e-9c72-80df8e006a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c093c7-a796-4a06-a544-6f2713b87de0', 'volume_size': 1, 'snapshot_id': 'fb11c954-c5c3-4267-895e-6c74774102cd'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:43:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdc165d-e5ca-4d4a-a8fb-b4eedcb34ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:43:32 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Volume volume-a5c093c7-a796-4a06-a544-6f2713b87de0 (a5c093c7-a796-4a06-a544-6f2713b87de0): created successfully Jul 17 15:43:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdc165d-e5ca-4d4a-a8fb-b4eedcb34ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:43:33 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Flow 'volume_create_manager' (47705959-eaf6-4ccb-ad27-f87e37ba6918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:43:33 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e8d957d7-d28f-4900-9c92-f915fc6f36d8 tempest-TestStampPattern-513760373 None] Created volume successfully. Jul 17 15:43:43 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:43:43 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=4,cinder:SELECT=6,cinder:DELETE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:44:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-a3eb2bd2-6e74-4686-8809-7dec4207b0ce req-54b34db2-2d25-45e7-a3dd-c9de6b9e790e tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-a3eb2bd2-6e74-4686-8809-7dec4207b0ce req-54b34db2-2d25-45e7-a3dd-c9de6b9e790e tempest-TestStampPattern-513760373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:14 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e726735-dbd5-40d6-ba29-d4085d1fa5de]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:44:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-a3eb2bd2-6e74-4686-8809-7dec4207b0ce req-54b34db2-2d25-45e7-a3dd-c9de6b9e790e tempest-TestStampPattern-513760373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:14 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 Jul 17 15:44:14 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:14 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [req-a3eb2bd2-6e74-4686-8809-7dec4207b0ce req-54b34db2-2d25-45e7-a3dd-c9de6b9e790e tempest-TestStampPattern-513760373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [req-a3eb2bd2-6e74-4686-8809-7dec4207b0ce req-54b34db2-2d25-45e7-a3dd-c9de6b9e790e tempest-TestStampPattern-513760373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.372s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:14 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-a3eb2bd2-6e74-4686-8809-7dec4207b0ce req-54b34db2-2d25-45e7-a3dd-c9de6b9e790e tempest-TestStampPattern-513760373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711', 'name': 'volume-a5c093c7-a796-4a06-a544-6f2713b87de0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8230e9d-393a-4804-bd34-2e5c31a9f383', 'enforce_multipath': True} {{(pid=87769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 15:44:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-a3eb2bd2-6e74-4686-8809-7dec4207b0ce req-54b34db2-2d25-45e7-a3dd-c9de6b9e790e tempest-TestStampPattern-513760373 None] attachment_update completed successfully. Jul 17 15:44:17 devstack cinder-volume[87769]: INFO cinder.volume.manager [req-d00bab12-c68a-4a4f-bf91-2133c49737cf req-a0c20aa4-1e6f-4870-9083-932711e6f2cd tempest-TestStampPattern-513760373 None] Terminate volume connection completed successfully. Jul 17 15:44:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [req-d00bab12-c68a-4a4f-bf91-2133c49737cf req-a0c20aa4-1e6f-4870-9083-932711e6f2cd tempest-TestStampPattern-513760373 None] Deleting attachment c8230e9d-393a-4804-bd34-2e5c31a9f383. {{(pid=87769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 15:44:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Acquiring lock "cinder-a5c093c7-a796-4a06-a544-6f2713b87de0-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Lock "cinder-a5c093c7-a796-4a06-a544-6f2713b87de0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Acquiring lock "cinder-quobyte-a5c093c7-a796-4a06-a544-6f2713b87de0" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-a5c093c7-a796-4a06-a544-6f2713b87de0" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:21 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[680e7693-f9b8-43b3-8724-f9483f36df6d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:44:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:22 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 Jul 17 15:44:22 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:22 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0" returned: 0 in 0.352s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:22 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0 Jul 17 15:44:22 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:22 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a5c093c7-a796-4a06-a544-6f2713b87de0" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-a5c093c7-a796-4a06-a544-6f2713b87de0" released by "delete_volume" :: held 0.639s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Created reservations ['fb1783a5-9368-4e25-9676-1d7898d89474', '4c03c88a-75d2-4408-85c9-e020f7c45c35', '3f6dc6e4-8485-4a16-bcdd-b007380d4141', '87f4a9d0-6d29-4d8e-886d-a17208834e30'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:22 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:44:22 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:22 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:44:22 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:22 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:44:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Deleted volume successfully. Jul 17 15:44:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-36a910bd-7751-4246-9df1-0eeeddfdc208 tempest-TestStampPattern-513760373 None] Lock "cinder-a5c093c7-a796-4a06-a544-6f2713b87de0-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:23 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.267s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Acquiring lock "cinder-fb11c954-c5c3-4267-895e-6c74774102cd-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Lock "cinder-fb11c954-c5c3-4267-895e-6c74774102cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Acquiring lock "cinder-quobyte-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Acquiring lock "cinder-quobyte-fb11c954-c5c3-4267-895e-6c74774102cd" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-fb11c954-c5c3-4267-895e-6c74774102cd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Deleting offline snapshot fb11c954-c5c3-4267-895e-6c74774102cd of volume 3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] snapshot_file for this snap is: volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[428ea245-04f8-4504-a947-b6d1bfece910]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:23 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd Jul 17 15:44:23 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:23 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd" returned: 0 in 0.360s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc39afd-bd3f-40f1-9fdd-fa7b1c6f7aa3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:44:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:23 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 Jul 17 15:44:23 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:24 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" returned: 0 in 0.385s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:24 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd Jul 17 15:44:24 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:24 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd" returned: 0 in 0.328s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:24 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd Jul 17 15:44:24 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:24 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802.fb11c954-c5c3-4267-895e-6c74774102cd" returned: 0 in 0.241s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-fb11c954-c5c3-4267-895e-6c74774102cd" released by "_delete_snapshot" :: held 1.412s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" released by "delete_snapshot" :: held 1.431s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:24 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Created reservations ['b6614930-046d-4ef7-b8e8-98137d86a677', '04818532-27e9-4270-b6e6-2bf68feecddd', 'a16a6ab7-1a28-4ddf-aaa7-ee2c1b0573ad', '39762dae-743d-45c5-b493-a079a7b77d3e'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:44:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Delete snapshot completed successfully. Jul 17 15:44:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-efad4230-b200-4745-a200-4185cc7a2382 tempest-TestStampPattern-513760373 None] Lock "cinder-fb11c954-c5c3-4267-895e-6c74774102cd-delete_snapshot" released by "delete_snapshot" :: held 1.563s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Acquiring lock "cinder-3b87f48f-e42a-4e89-8a24-1c1d9d28d802-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Lock "cinder-3b87f48f-e42a-4e89-8a24-1c1d9d28d802-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Acquiring lock "cinder-quobyte-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:28 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4c070b-5a94-4d00-8109-385fe66edf40]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:44:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:29 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 Jul 17 15:44:29 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:29 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" returned: 0 in 0.356s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:29 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802 Jul 17 15:44:29 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:29 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" returned: 0 in 0.258s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Lock "cinder-quobyte-3b87f48f-e42a-4e89-8a24-1c1d9d28d802" released by "delete_volume" :: held 0.673s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Created reservations ['95d03e92-2e59-4c39-a0e6-61a0a15a3016', '53dd3bd7-c301-49bc-8385-b2d9adc8b9cd', 'c3b83ec3-0dad-4e72-bb07-ef92b1d5bace', 'bee038f3-e0d9-4a39-8654-ca1c38bdd6e7'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:29 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:44:29 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:29 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.274s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:44:29 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Deleted volume successfully. Jul 17 15:44:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a8d32f37-55bf-4521-a1e8-7f3cf434eb81 tempest-TestStampPattern-513760373 None] Lock "cinder-3b87f48f-e42a-4e89-8a24-1c1d9d28d802-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:39 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=7 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:44:39 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Flow 'volume_create_manager' (64d3cb9d-7ad0-461a-88fa-c8d7d50e4e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d10c715-055d-477f-9c79-d9448e2b7dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d10c715-055d-477f-9c79-d9448e2b7dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993234667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb4d49d-9a76-46f6-9a6d-6804172f30db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8890a95b214c4f6cb4ebedf6b0175188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:44:41Z,use_quota=True,user_id='930c4d32a28c405eb28553ca39b0c7e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0b01c6-2b0b-4940-b1af-ff8ddeb42914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0b01c6-2b0b-4940-b1af-ff8ddeb42914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07f0a9a-46fc-44fb-851a-538e02274a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07f0a9a-46fc-44fb-851a-538e02274a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb4d49d-9a76-46f6-9a6d-6804172f30db', 'volume_name': 'volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009c90a3-fb56-495b-90bb-300be90575c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009c90a3-fb56-495b-90bb-300be90575c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a82e9b7-37a3-446e-8bf8-4a599d32f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:40 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Volume 3bb4d49d-9a76-46f6-9a6d-6804172f30db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db', 'volume_size': 1} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993234667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb4d49d-9a76-46f6-9a6d-6804172f30db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8890a95b214c4f6cb4ebedf6b0175188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:44:41Z,use_quota=True,user_id='930c4d32a28c405eb28553ca39b0c7e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Creating volume 3bb4d49d-9a76-46f6-9a6d-6804172f30db {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:44:40 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:44:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:40 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db 1073741824 Jul 17 15:44:40 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:41 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db 1073741824" returned: 0 in 0.398s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:41 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db Jul 17 15:44:41 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:41 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db" returned: 0 in 0.250s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:44:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a82e9b7-37a3-446e-8bf8-4a599d32f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d642e69-d7db-499f-9d49-f31d695b51ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:41 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Volume volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db (3bb4d49d-9a76-46f6-9a6d-6804172f30db): created successfully Jul 17 15:44:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d642e69-d7db-499f-9d49-f31d695b51ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:41 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Flow 'volume_create_manager' (64d3cb9d-7ad0-461a-88fa-c8d7d50e4e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:44:41 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0bb1aed6-95e5-47fb-9b69-2aa537f3196e tempest-ProjectReaderTests-442666083 None] Created volume successfully. Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Acquiring lock "cinder-3bb4d49d-9a76-46f6-9a6d-6804172f30db-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Lock "cinder-3bb4d49d-9a76-46f6-9a6d-6804172f30db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Acquiring lock "cinder-quobyte-3bb4d49d-9a76-46f6-9a6d-6804172f30db" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Lock "cinder-quobyte-3bb4d49d-9a76-46f6-9a6d-6804172f30db" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd4165c-9a35-4c75-9f31-6289a3b889cf]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:42 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db Jul 17 15:44:42 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:42 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db" returned: 0 in 0.345s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:42 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db Jul 17 15:44:42 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:42 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-3bb4d49d-9a76-46f6-9a6d-6804172f30db" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Lock "cinder-quobyte-3bb4d49d-9a76-46f6-9a6d-6804172f30db" released by "delete_volume" :: held 0.624s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Created reservations ['6f09f323-fa04-4c05-8698-c22e2a2b2946', '2da7b1f0-499e-4947-afad-1913f18d8a59', '25d63dbd-c239-4176-947b-3abc2cca0398', 'b6b02946-1aae-4936-bc3b-32fd42fbb377'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:42 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:44:42 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:43 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.250s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:44:43 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Deleted volume successfully. Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ba9a1270-74e8-4fed-8705-ca0ca5d2cc3a tempest-ProjectReaderTests-442666083 None] Lock "cinder-3bb4d49d-9a76-46f6-9a6d-6804172f30db-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Flow 'volume_create_manager' (0c535ee4-570e-4a8d-84e4-8220b3a9be3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cfc221-b6ad-4cf4-93b6-08c51c09d554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cfc221-b6ad-4cf4-93b6-08c51c09d554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554290382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8890a95b214c4f6cb4ebedf6b0175188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:44:44Z,use_quota=True,user_id='930c4d32a28c405eb28553ca39b0c7e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e5d1cc-413c-4dc7-b124-3d12e78fc926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e5d1cc-413c-4dc7-b124-3d12e78fc926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e436d25-0931-4ed2-a0d5-9173f0c0fad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e436d25-0931-4ed2-a0d5-9173f0c0fad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a', 'volume_name': 'volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a6da23-e31d-4228-a4a9-0a8fe965dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a6da23-e31d-4228-a4a9-0a8fe965dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ae971d-3bf1-4a32-a442-e2fb61dcc9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:43 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Volume bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a', 'volume_size': 1} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554290382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8890a95b214c4f6cb4ebedf6b0175188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:44:44Z,use_quota=True,user_id='930c4d32a28c405eb28553ca39b0c7e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Creating volume bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:44:43 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:44:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:43 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a 1073741824 Jul 17 15:44:43 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:44 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a 1073741824" returned: 0 in 0.416s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:44 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a Jul 17 15:44:44 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:44 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ae971d-3bf1-4a32-a442-e2fb61dcc9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bfdf7d-5ba9-41ac-b371-009e782fe97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:44:44 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Volume volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a (bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a): created successfully Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bfdf7d-5ba9-41ac-b371-009e782fe97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Flow 'volume_create_manager' (0c535ee4-570e-4a8d-84e4-8220b3a9be3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:44:44 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fa86cf35-85d8-4936-844c-e7756147386a tempest-ProjectReaderTests-442666083 None] Created volume successfully. Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Acquiring lock "cinder-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Lock "cinder-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Acquiring lock "cinder-quobyte-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Lock "cinder-quobyte-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d51f9d-9988-4ff1-a6c2-443ce710ce55]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:44:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:44 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a Jul 17 15:44:44 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:45 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:45 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a Jul 17 15:44:45 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:45 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Lock "cinder-quobyte-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a" released by "delete_volume" :: held 0.631s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Created reservations ['a21bce88-e648-4eb2-a2d3-6880e3231686', '20bab508-8473-4400-b129-3bb7e776f7d0', 'c62c1312-6ecf-421e-a1fd-9878084ff737', '5f15a58b-f13a-49b5-bab3-44d0386c3825'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:44:45 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:44:45 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:44:45 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.248s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:44:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Deleted volume successfully. Jul 17 15:44:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3ea8e6ec-ffb6-498c-aed4-756ea74d61b9 tempest-ProjectReaderTests-442666083 None] Lock "cinder-bddd462c-08b0-4b9f-b4fc-d2dca1b6ce4a-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:44:55 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=14,cinder:UPDATE=25,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:44:55 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=19,cinder:SELECT=14,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Flow 'volume_create_manager' (a390724f-98fe-49b2-b808-30f8f409344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7573b99-c508-4f3f-b759-73c169f901ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7573b99-c508-4f3f-b759-73c169f901ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-685794021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b8be7b-43bc-49a2-a0f3-78dcd115b20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89180a8cfce444a1bd52705cf323e03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:11Z,use_quota=True,user_id='ef12e8dfb19341afbdf05b38f0802a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99bf512-a020-4cae-92a2-43a99c21537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99bf512-a020-4cae-92a2-43a99c21537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed19b4b-ea22-43b4-adf5-7cfabf76e969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed19b4b-ea22-43b4-adf5-7cfabf76e969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b8be7b-43bc-49a2-a0f3-78dcd115b20e', 'volume_name': 'volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d72d0f-181c-4ed2-9b40-d001241b64a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d72d0f-181c-4ed2-9b40-d001241b64a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a6d124-0b85-4c33-8301-bd7af2c42bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:11 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Volume b7b8be7b-43bc-49a2-a0f3-78dcd115b20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e', 'volume_size': 1} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-685794021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b8be7b-43bc-49a2-a0f3-78dcd115b20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89180a8cfce444a1bd52705cf323e03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:11Z,use_quota=True,user_id='ef12e8dfb19341afbdf05b38f0802a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Creating volume b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:11 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:11 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e 1073741824 Jul 17 15:45:11 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:11 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e 1073741824" returned: 0 in 0.413s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:12 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e Jul 17 15:45:12 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:12 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a6d124-0b85-4c33-8301-bd7af2c42bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e146c19-ab30-4308-b14e-e3a6bef88724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:12 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Volume volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e (b7b8be7b-43bc-49a2-a0f3-78dcd115b20e): created successfully Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e146c19-ab30-4308-b14e-e3a6bef88724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Flow 'volume_create_manager' (a390724f-98fe-49b2-b808-30f8f409344d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:12 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d7ced623-60bb-4f67-82a8-a2364b13dd5a tempest-SnapshotDependencyTests-665405377 None] Created volume successfully. Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Creating offline snapshot c95224c2-d874-4c83-8ea8-b7dbf5c4f98f of volume b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ec5fcd-bf99-4ccb-845f-67ab14c65e31]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:12 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e Jul 17 15:45:12 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:13 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" returned: 0 in 0.357s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:13 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f 1G Jul 17 15:45:13 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:13 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f 1G" returned: 0 in 0.375s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:13 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f Jul 17 15:45:13 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:13 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f" returned: 0 in 0.279s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:13 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f is being set with open permissions: ugo+rw Jul 17 15:45:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:13 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f Jul 17 15:45:13 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:14 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f" returned: 0 in 0.241s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:14 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.info Jul 17 15:45:14 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:14 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.info" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:14 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.info is being set with open permissions: ugo+rw Jul 17 15:45:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:14 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.info Jul 17 15:45:14 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:14 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.info" returned: 0 in 0.239s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d3f18417-c3b0-49fe-998e-28a27f449369 tempest-SnapshotDependencyTests-665405377 None] Create snapshot completed successfully Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Flow 'volume_create_manager' (ac755194-6cdd-4102-8a4e-6282baf300a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6e4b5e-2f97-4bfc-8424-21dd73a44e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6e4b5e-2f97-4bfc-8424-21dd73a44e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88684e02-513d-4c3e-98b6-04baa8525f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89180a8cfce444a1bd52705cf323e03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c95224c2-d874-4c83-8ea8-b7dbf5c4f98f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:15Z,use_quota=True,user_id='ef12e8dfb19341afbdf05b38f0802a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96a0cbd-16a7-49a3-b2d5-3a06fd34f22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96a0cbd-16a7-49a3-b2d5-3a06fd34f22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c93582-254f-435c-9f40-5af3843d84ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c93582-254f-435c-9f40-5af3843d84ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88684e02-513d-4c3e-98b6-04baa8525f70', 'volume_name': 'volume-88684e02-513d-4c3e-98b6-04baa8525f70', 'volume_size': 1, 'snapshot_id': 'c95224c2-d874-4c83-8ea8-b7dbf5c4f98f'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc7ad65-c78d-47f7-bdc3-509ed01864f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc7ad65-c78d-47f7-bdc3-509ed01864f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d34eaf8-fab5-4114-81a7-246980d61b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:15 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Volume 88684e02-513d-4c3e-98b6-04baa8525f70: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88684e02-513d-4c3e-98b6-04baa8525f70', 'volume_size': 1, 'snapshot_id': 'c95224c2-d874-4c83-8ea8-b7dbf5c4f98f'} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "cinder-quobyte-c95224c2-d874-4c83-8ea8-b7dbf5c4f98f-88684e02-513d-4c3e-98b6-04baa8525f70" by "_create_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-c95224c2-d874-4c83-8ea8-b7dbf5c4f98f-88684e02-513d-4c3e-98b6-04baa8525f70" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Creating volume 88684e02-513d-4c3e-98b6-04baa8525f70 from snapshot c95224c2-d874-4c83-8ea8-b7dbf5c4f98f {{(pid=87769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "cinder-quobyte-88684e02-513d-4c3e-98b6-04baa8525f70" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-88684e02-513d-4c3e-98b6-04baa8525f70" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] snapshot: c95224c2-d874-4c83-8ea8-b7dbf5c4f98f, volume: 88684e02-513d-4c3e-98b6-04baa8525f70, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c759e1-9aae-4a7f-bd20-c8ad450bdd28]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:15 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f Jul 17 15:45:15 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:15 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f" returned: 0 in 0.342s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e67fe0-73b6-4a94-aed3-dd5ce72c3851]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:15 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e Jul 17 15:45:15 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:16 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" returned: 0 in 0.358s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:16 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:45:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:16 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 Jul 17 15:45:16 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:20 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70" returned: 0 in 4.034s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:20 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[034be48b-7f66-4935-b6e4-3c32dfc6501b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:20 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e Jul 17 15:45:20 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:20 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" returned: 0 in 0.515s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:20 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:45:20 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Converted 1024.00 MB image at 253.74 MB/s Jul 17 15:45:20 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 is being set with open permissions: ugo+rw Jul 17 15:45:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:20 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 Jul 17 15:45:20 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:21 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70" returned: 0 in 0.246s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-88684e02-513d-4c3e-98b6-04baa8525f70" released by "_copy_volume_from_snapshot" :: held 5.582s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-c95224c2-d874-4c83-8ea8-b7dbf5c4f98f-88684e02-513d-4c3e-98b6-04baa8525f70" released by "_create_volume_from_snapshot" :: held 5.612s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.627s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d34eaf8-fab5-4114-81a7-246980d61b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88684e02-513d-4c3e-98b6-04baa8525f70', 'volume_size': 1, 'snapshot_id': 'c95224c2-d874-4c83-8ea8-b7dbf5c4f98f'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0a0a12-3b76-4542-99f0-e26419fc18b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Volume volume-88684e02-513d-4c3e-98b6-04baa8525f70 (88684e02-513d-4c3e-98b6-04baa8525f70): created successfully Jul 17 15:45:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0a0a12-3b76-4542-99f0-e26419fc18b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Flow 'volume_create_manager' (ac755194-6cdd-4102-8a4e-6282baf300a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a1175851-d0e4-4c92-a5f1-ec2885c6654f tempest-SnapshotDependencyTests-665405377 None] Created volume successfully. Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "cinder-c95224c2-d874-4c83-8ea8-b7dbf5c4f98f-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-c95224c2-d874-4c83-8ea8-b7dbf5c4f98f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "cinder-quobyte-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "cinder-quobyte-c95224c2-d874-4c83-8ea8-b7dbf5c4f98f" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-c95224c2-d874-4c83-8ea8-b7dbf5c4f98f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Deleting offline snapshot c95224c2-d874-4c83-8ea8-b7dbf5c4f98f of volume b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] snapshot_file for this snap is: volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe175b9-ab36-4c0f-9826-1acb78505f2c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:22 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f Jul 17 15:45:22 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:22 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f" returned: 0 in 0.349s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a188c8c-af9f-43fb-b48f-c571755cd8d7]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:22 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e Jul 17 15:45:22 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:22 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:22 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:22 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" returned: 0 in 0.358s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:22 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f Jul 17 15:45:22 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:23 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.265s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:45:23 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f" returned: 0 in 0.338s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:23 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f Jul 17 15:45:23 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:23 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e.c95224c2-d874-4c83-8ea8-b7dbf5c4f98f" returned: 0 in 0.236s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-c95224c2-d874-4c83-8ea8-b7dbf5c4f98f" released by "_delete_snapshot" :: held 1.372s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" released by "delete_snapshot" :: held 1.396s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Created reservations ['9609c37e-6100-4ebf-818c-2aa527534385', 'b55f537d-c1bd-4471-8a00-08ed39d7b505', 'c0fe515e-6fd3-46ed-88f4-3144d3b05b29', '3e6cc3e9-1c61-484f-b44a-fefbc90fe376'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Delete snapshot completed successfully. Jul 17 15:45:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-df440cec-6b51-4d1f-bf79-742171457e53 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-c95224c2-d874-4c83-8ea8-b7dbf5c4f98f-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "cinder-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "cinder-quobyte-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" acquired by "delete_volume" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa5d3d3-312f-434b-8f5d-2e6e46c3f263]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:24 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e Jul 17 15:45:24 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:24 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" returned: 0 in 0.340s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:24 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e Jul 17 15:45:24 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:24 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" returned: 0 in 0.237s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e" released by "delete_volume" :: held 0.631s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Created reservations ['3208a2a8-ab45-4ff1-97af-130814229f8a', '45a77f53-53fe-490d-8141-09113875cf6c', 'd5a4da48-e68d-45b0-86e2-a9d7cd7b06d4', '36debba9-74fc-4738-ad83-91a4a55897ea'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:24 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:24 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:25 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.240s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:45:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Deleted volume successfully. Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-868951c8-5503-4988-be7f-3e5fec8d0ed9 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-b7b8be7b-43bc-49a2-a0f3-78dcd115b20e-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "cinder-88684e02-513d-4c3e-98b6-04baa8525f70-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-88684e02-513d-4c3e-98b6-04baa8525f70-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "cinder-quobyte-88684e02-513d-4c3e-98b6-04baa8525f70" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-88684e02-513d-4c3e-98b6-04baa8525f70" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ae89d8-9335-4836-b8a6-959f2ad648d1]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:25 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 Jul 17 15:45:25 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:25 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:25 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70 Jul 17 15:45:25 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:26 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-88684e02-513d-4c3e-98b6-04baa8525f70" returned: 0 in 0.248s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-quobyte-88684e02-513d-4c3e-98b6-04baa8525f70" released by "delete_volume" :: held 0.634s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Created reservations ['a1fe4bac-1e8e-4dc9-87ff-2d0c2f8c617d', '45c3df13-7cfb-4d39-aede-eb1139b04587', 'bb54094f-ca3e-469c-ab82-edd39dded173', '7fcd29b5-bed5-4e47-a2dc-fdb1c04f02f0'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:26 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:26 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:26 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.234s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:45:26 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Deleted volume successfully. Jul 17 15:45:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5629bd0-7cf8-46d7-b74b-0d2c438af650 tempest-SnapshotDependencyTests-665405377 None] Lock "cinder-88684e02-513d-4c3e-98b6-04baa8525f70-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:36 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=22,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:45:36 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (21c6ac0a-4728-4748-8d39-f1223fed9004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08b0270-9e72-4003-99ad-3872e39fc993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08b0270-9e72-4003-99ad-3872e39fc993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893842627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50de305-bead-46c1-9845-3525dd446789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:45Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d061c93-7252-45c5-a2da-c59b2b22b70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d061c93-7252-45c5-a2da-c59b2b22b70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec501b9-d3dd-4a62-af8d-33767d40bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec501b9-d3dd-4a62-af8d-33767d40bda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50de305-bead-46c1-9845-3525dd446789', 'volume_name': 'volume-d50de305-bead-46c1-9845-3525dd446789', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be020816-bb43-44d3-8fb9-04b1808fb456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be020816-bb43-44d3-8fb9-04b1808fb456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de4aa91-d539-453c-b2a6-0a7900eed683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:44 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume d50de305-bead-46c1-9845-3525dd446789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50de305-bead-46c1-9845-3525dd446789', 'volume_size': 1} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893842627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50de305-bead-46c1-9845-3525dd446789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:45Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Creating volume d50de305-bead-46c1-9845-3525dd446789 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:44 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:45 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789 1073741824 Jul 17 15:45:45 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (49ef095e-08cb-406a-9a76-2754f688194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74098356-2f54-48dc-94f3-8f0910f7933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74098356-2f54-48dc-94f3-8f0910f7933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694595301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38ad805-16ef-4fd7-8821-e96caa54f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:45Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a6270f-9d13-49b3-83f3-94923481bde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a6270f-9d13-49b3-83f3-94923481bde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b704dec9-7aa1-4613-9b2d-1c40473ca0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b704dec9-7aa1-4613-9b2d-1c40473ca0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38ad805-16ef-4fd7-8821-e96caa54f616', 'volume_name': 'volume-b38ad805-16ef-4fd7-8821-e96caa54f616', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c18fc54-f336-45d7-b40b-eb67b237f864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c18fc54-f336-45d7-b40b-eb67b237f864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de953188-2c14-48fd-a7fb-fc8963aaffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Volume b38ad805-16ef-4fd7-8821-e96caa54f616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38ad805-16ef-4fd7-8821-e96caa54f616', 'volume_size': 1} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (b7e96cdf-8789-44eb-9d27-713dc054849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8de698-e3bd-4cee-bf6e-bcf1c2b653ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8de698-e3bd-4cee-bf6e-bcf1c2b653ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1468972257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:45Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9473ae21-d034-4c60-af47-936dd86c57a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9473ae21-d034-4c60-af47-936dd86c57a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fa6be8-2fff-4fd0-90e0-a1b7f5cabd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fa6be8-2fff-4fd0-90e0-a1b7f5cabd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5', 'volume_name': 'volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1752761-f366-4165-8c38-e393cf7a1681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1752761-f366-4165-8c38-e393cf7a1681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1ff7f9-d07d-41b1-822a-e46a3d28f596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Volume 6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5', 'volume_size': 1} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:45 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789 1073741824" returned: 0 in 0.751s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:45 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789 Jul 17 15:45:45 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (8b1ae0a5-cfc3-42fe-bbf5-33e0d9afb0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caafed92-f1af-4672-b82e-3fb4f49a2b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caafed92-f1af-4672-b82e-3fb4f49a2b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1741985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c943015d-5808-49f5-b7ce-6dc34d332462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:46Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d43095-9213-4c62-8c22-0b3b5cb9015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d43095-9213-4c62-8c22-0b3b5cb9015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298689f1-b4c3-4e30-bdad-41bcf38bb51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298689f1-b4c3-4e30-bdad-41bcf38bb51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c943015d-5808-49f5-b7ce-6dc34d332462', 'volume_name': 'volume-c943015d-5808-49f5-b7ce-6dc34d332462', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0621fd4-4e64-4ac6-997c-0045b0243e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0621fd4-4e64-4ac6-997c-0045b0243e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff01cd87-bdb0-4a92-980c-bcb5ac6f8f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Volume c943015d-5808-49f5-b7ce-6dc34d332462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c943015d-5808-49f5-b7ce-6dc34d332462', 'volume_size': 1} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:46 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694595301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38ad805-16ef-4fd7-8821-e96caa54f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:45Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Creating volume b38ad805-16ef-4fd7-8821-e96caa54f616 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:46 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de4aa91-d539-453c-b2a6-0a7900eed683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50de305-bead-46c1-9845-3525dd446789', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754ddbe1-c7ad-472a-816f-b618c2081eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616 1073741824 Jul 17 15:45:46 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:46 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume volume-d50de305-bead-46c1-9845-3525dd446789 (d50de305-bead-46c1-9845-3525dd446789): created successfully Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754ddbe1-c7ad-472a-816f-b618c2081eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (21c6ac0a-4728-4748-8d39-f1223fed9004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:46 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5d73e8e9-8e97-4166-8266-f4b3927c953b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created volume successfully. Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (1c6dc7b5-23e1-41dc-b49c-35f7f8ac388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e21867-c6ea-4bab-9ffe-f7b96f3f0f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e21867-c6ea-4bab-9ffe-f7b96f3f0f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234130529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd2f344-ef88-4546-9399-a6308ff9bf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:46Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28502747-32b8-4a8f-879e-00d4f696d663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28502747-32b8-4a8f-879e-00d4f696d663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d4a87d-a2db-4bde-a997-d55c644db2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d4a87d-a2db-4bde-a997-d55c644db2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd2f344-ef88-4546-9399-a6308ff9bf72', 'volume_name': 'volume-9cd2f344-ef88-4546-9399-a6308ff9bf72', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e4ce40-6116-4528-ab9e-a96e8d21c2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e4ce40-6116-4528-ab9e-a96e8d21c2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30479de-5770-4e00-b864-ac0994fd8975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Volume 9cd2f344-ef88-4546-9399-a6308ff9bf72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd2f344-ef88-4546-9399-a6308ff9bf72', 'volume_size': 1} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:46 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (917755d3-cc8e-4f3a-9fae-6eb344241a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba09600a-11bc-4482-9c3f-02c42da70440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616 1073741824" returned: 0 in 0.791s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba09600a-11bc-4482-9c3f-02c42da70440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2117432436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9970a4-2a9d-4fbe-8702-1138c08d9da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:47Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdafdac-5b8d-4392-a20e-00a6980901f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdafdac-5b8d-4392-a20e-00a6980901f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa27212e-e0d1-46cf-80b3-e680c79fbdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa27212e-e0d1-46cf-80b3-e680c79fbdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9970a4-2a9d-4fbe-8702-1138c08d9da1', 'volume_name': 'volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c8408d-146c-4fb8-9514-437544f64584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c8408d-146c-4fb8-9514-437544f64584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39863e6f-f951-4b96-8dad-1e7e89dff124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:47 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Volume dd9970a4-2a9d-4fbe-8702-1138c08d9da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1', 'volume_size': 1} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:47 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616 Jul 17 15:45:47 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:47 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616" returned: 0 in 0.449s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1468972257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:45Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Creating volume 6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:47 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:47 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 1073741824 Jul 17 15:45:47 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de953188-2c14-48fd-a7fb-fc8963aaffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38ad805-16ef-4fd7-8821-e96caa54f616', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965e1e5f-bd16-462b-a3ee-9ff73b6a0c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:47 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Volume volume-b38ad805-16ef-4fd7-8821-e96caa54f616 (b38ad805-16ef-4fd7-8821-e96caa54f616): created successfully Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965e1e5f-bd16-462b-a3ee-9ff73b6a0c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (49ef095e-08cb-406a-9a76-2754f688194e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (85c47d15-190d-4aca-ac7d-79fb3a94c0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa62881-34fe-484e-871b-20efb24f7d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa62881-34fe-484e-871b-20efb24f7d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128422253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b42a43-2326-4c62-a8e8-b55889968995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:48Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c606b6e-8456-424e-afb5-65eacc367ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c606b6e-8456-424e-afb5-65eacc367ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9816cdd6-0e47-4e10-8408-644f6b43a661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9816cdd6-0e47-4e10-8408-644f6b43a661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b42a43-2326-4c62-a8e8-b55889968995', 'volume_name': 'volume-c8b42a43-2326-4c62-a8e8-b55889968995', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595cf91c-82cb-419d-b96a-5abead29e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595cf91c-82cb-419d-b96a-5abead29e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de42c7ff-c1de-422c-a99a-69b8997ebae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:47 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume c8b42a43-2326-4c62-a8e8-b55889968995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b42a43-2326-4c62-a8e8-b55889968995', 'volume_size': 1} Jul 17 15:45:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:47 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-64bb7979-ee33-48a1-93b6-ba40a6ff9eff tempest-CreateVolumesFromImageTest-1388975527 None] Created volume successfully. Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (d2a9b7e1-dbb2-4c26-88a0-397cc6e95cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d922af-9498-4687-b579-600a4f190f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:48 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d922af-9498-4687-b579-600a4f190f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696440254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9585c9-797f-4991-ad53-fd6648302dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:48Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79ab6bb-ab0d-4963-bce0-b7191331541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79ab6bb-ab0d-4963-bce0-b7191331541d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7137aca3-f763-414e-875a-6ca5b55186bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7137aca3-f763-414e-875a-6ca5b55186bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9585c9-797f-4991-ad53-fd6648302dfc', 'volume_name': 'volume-5f9585c9-797f-4991-ad53-fd6648302dfc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d09d160-9886-4918-a876-66ce0238018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d09d160-9886-4918-a876-66ce0238018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7f279c-c0d3-4603-a53f-69bf0bd039e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:48 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume 5f9585c9-797f-4991-ad53-fd6648302dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9585c9-797f-4991-ad53-fd6648302dfc', 'volume_size': 1} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 1073741824" returned: 0 in 0.818s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:48 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 Jul 17 15:45:48 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:48 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5" returned: 0 in 0.319s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.664s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1741985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c943015d-5808-49f5-b7ce-6dc34d332462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:46Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Creating volume c943015d-5808-49f5-b7ce-6dc34d332462 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:48 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:48 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462 1073741824 Jul 17 15:45:48 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1ff7f9-d07d-41b1-822a-e46a3d28f596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe200c6-4b04-42a7-aa45-6557525f7e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:48 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Volume volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 (6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5): created successfully Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe200c6-4b04-42a7-aa45-6557525f7e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (b7e96cdf-8789-44eb-9d27-713dc054849d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6930d381-7b12-4490-bd8a-d4df29e37070 tempest-CreateVolumesFromImageTest-1388975527 None] Created volume successfully. Jul 17 15:45:48 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (02ad0ef0-b07d-4948-9c93-f51176a71beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1da584a-90b3-4a5a-aa88-bf8433fb66a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1da584a-90b3-4a5a-aa88-bf8433fb66a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056551296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05376d4-c772-4578-b376-14eaea08c604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:49Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b7cac7-3fe3-411d-b435-4482334d6515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b7cac7-3fe3-411d-b435-4482334d6515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96f1646-bbca-4a70-a65d-d3d2c9e0d957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96f1646-bbca-4a70-a65d-d3d2c9e0d957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c05376d4-c772-4578-b376-14eaea08c604', 'volume_name': 'volume-c05376d4-c772-4578-b376-14eaea08c604', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473996bf-e6a0-4057-bdcb-6e9c3ef3714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473996bf-e6a0-4057-bdcb-6e9c3ef3714c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26531daa-a837-4499-b236-1fe06a072cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume c05376d4-c772-4578-b376-14eaea08c604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c05376d4-c772-4578-b376-14eaea08c604', 'volume_size': 1} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:49 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462 1073741824" returned: 0 in 0.626s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:49 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462 Jul 17 15:45:49 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Flow 'volume_create_manager' (af328013-c1ae-4622-897e-51a4c6e2c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb76599-a169-48c8-b887-e7393de9bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb76599-a169-48c8-b887-e7393de9bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05532d31-89d1-4a2b-91a5-add72ba8ad9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374f2d0d210041c6adedad194612291a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:49Z,use_quota=True,user_id='8dd58d1cb061450c8b22f63fc610c5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a178c2-3409-441e-ad3c-703519496442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a178c2-3409-441e-ad3c-703519496442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b1de4f-00ca-432f-b72f-5f10a1629ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.image.glance [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Creating Keystone auth plugin from conf {{(pid=87769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 15:45:49 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462" returned: 0 in 0.334s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.308s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234130529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd2f344-ef88-4546-9399-a6308ff9bf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:46Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Creating volume 9cd2f344-ef88-4546-9399-a6308ff9bf72 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:49 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:49 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 1073741824 Jul 17 15:45:49 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (631dd3d5-310a-444b-ad5c-52d9abb7cb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6037612-ac47-40e5-a014-da52c11b09ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff01cd87-bdb0-4a92-980c-bcb5ac6f8f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c943015d-5808-49f5-b7ce-6dc34d332462', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca98ecea-3000-4811-8ac8-7e07c27fa62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6037612-ac47-40e5-a014-da52c11b09ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-645254911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2b826a-3ad7-4962-b4b8-532a8b86a962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:50Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ed71e3-bef2-4ea0-b768-36a0e3215834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ed71e3-bef2-4ea0-b768-36a0e3215834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262fae9e-dea8-473f-b3bb-9d377c365c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262fae9e-dea8-473f-b3bb-9d377c365c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2b826a-3ad7-4962-b4b8-532a8b86a962', 'volume_name': 'volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608dd386-53f7-4f73-a351-a428835a7715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608dd386-53f7-4f73-a351-a428835a7715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5237468-dc3a-4a90-b96c-858dbafc93bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume bc2b826a-3ad7-4962-b4b8-532a8b86a962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962', 'volume_size': 1} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Volume volume-c943015d-5808-49f5-b7ce-6dc34d332462 (c943015d-5808-49f5-b7ce-6dc34d332462): created successfully Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca98ecea-3000-4811-8ac8-7e07c27fa62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (8b1ae0a5-cfc3-42fe-bbf5-33e0d9afb0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (659108ec-4183-4ebe-a544-dc54f746dd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af188bd3-33ea-4e0a-8610-df175258af94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e7e3ba3c-5eae-4a33-92d0-8e97012c3865 tempest-CreateVolumesFromImageTest-1388975527 None] Created volume successfully. Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af188bd3-33ea-4e0a-8610-df175258af94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-428262938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08259a45-93b4-4dc7-929c-389e6618668e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:50Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385e4429-0e15-4e35-9391-f1fa39fdeca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385e4429-0e15-4e35-9391-f1fa39fdeca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1875c07-88ed-499d-ad33-66cf5326ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1875c07-88ed-499d-ad33-66cf5326ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08259a45-93b4-4dc7-929c-389e6618668e', 'volume_name': 'volume-08259a45-93b4-4dc7-929c-389e6618668e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7728ec5b-0471-4ad2-8e80-a26853131581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7728ec5b-0471-4ad2-8e80-a26853131581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d00b8ef-f44e-4fa5-8af5-ec90cae46782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume 08259a45-93b4-4dc7-929c-389e6618668e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08259a45-93b4-4dc7-929c-389e6618668e', 'volume_size': 1} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b1de4f-00ca-432f-b72f-5f10a1629ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05532d31-89d1-4a2b-91a5-add72ba8ad9c', 'volume_name': 'volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c', 'volume_size': 1, 'image_id': 'a887e36f-01e4-48bd-9234-a196d275cd3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a887e36f-01e4-48bd-9234-a196d275cd3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '227268eb1959cd1d77e64d14029c1f4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '374f2d0d210041c6adedad194612291a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '858bfd4b00a170aaa54e4186514a2b3cee6976401ff8a0e4134de7a9ddb1779af34a62cff6f6bb2abd0020d83c8b7f2c872d48f79e5c908792feece2e4a23a01', 'id': 'a887e36f-01e4-48bd-9234-a196d275cd3c', 'created_at': datetime.datetime(2026, 7, 17, 13, 45, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 45, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a887e36f-01e4-48bd-9234-a196d275cd3c/file', 'properties': {}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2af31b-1dec-4f32-aaa7-cdbc730dcb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2af31b-1dec-4f32-aaa7-cdbc730dcb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecbd3d7-b945-46b6-98ac-a2519f3a73f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Volume 05532d31-89d1-4a2b-91a5-add72ba8ad9c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c', 'volume_size': 1, 'image_id': 'a887e36f-01e4-48bd-9234-a196d275cd3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a887e36f-01e4-48bd-9234-a196d275cd3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '227268eb1959cd1d77e64d14029c1f4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '374f2d0d210041c6adedad194612291a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '858bfd4b00a170aaa54e4186514a2b3cee6976401ff8a0e4134de7a9ddb1779af34a62cff6f6bb2abd0020d83c8b7f2c872d48f79e5c908792feece2e4a23a01', 'id': 'a887e36f-01e4-48bd-9234-a196d275cd3c', 'created_at': datetime.datetime(2026, 7, 17, 13, 45, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 45, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a887e36f-01e4-48bd-9234-a196d275cd3c/file', 'properties': {}}, 'image_service': } Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Trying to clone 05532d31-89d1-4a2b-91a5-add72ba8ad9c from image a887e36f-01e4-48bd-9234-a196d275cd3c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a887e36f-01e4-48bd-9234-a196d275cd3c', 'metadata': {}}]). {{(pid=87769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Image download 0.00 MB at 0.00 MB/s Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a81f94-641a-4240-ac2c-3093e70a4ff5]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:50 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 1073741824" returned: 0 in 0.564s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Flow 'volume_create_manager' (47e30ada-8735-4d49-96b9-65d63fe2c7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4b9c30-3472-438c-b98f-2ad10d229dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4b9c30-3472-438c-b98f-2ad10d229dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940c3c228656413ba3fd715c31bd9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:50Z,use_quota=True,user_id='a4827af9407a4a51b862441ce48b7d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e28bdca8-39dd-45f8-8ebe-83484da70f74),volume_type_id=e28bdca8-39dd-45f8-8ebe-83484da70f74)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 Jul 17 15:45:50 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b713290-37cc-4960-a58e-8d35331079f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD Jul 17 15:45:50 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b713290-37cc-4960-a58e-8d35331079f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9f0712-2096-4d3b-a85a-637fb4ded171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.image.glance [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Creating Keystone auth plugin from conf {{(pid=87769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 15:45:50 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9f0712-2096-4d3b-a85a-637fb4ded171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf', 'volume_name': 'volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf', 'volume_size': 1, 'image_id': '7332610d-b4b1-4ab3-a768-204c4149bc0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7332610d-b4b1-4ab3-a768-204c4149bc0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b2c17802e9bdbf0aa1f52943ca38caa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '940c3c228656413ba3fd715c31bd9ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '676bf539db6daeeb63e3114e93db344bcf5aa7fbd7c4e9077eede44d89f6cced9351c1bedb7a807cceb62f9d902e9e8519aaafb1a34a4af166758957a3d85040', 'id': '7332610d-b4b1-4ab3-a768-204c4149bc0b', 'created_at': datetime.datetime(2026, 7, 17, 13, 45, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 45, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7332610d-b4b1-4ab3-a768-204c4149bc0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05691f7-707d-4928-9fe2-7f042fe2b154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05691f7-707d-4928-9fe2-7f042fe2b154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c80a584-066b-43cb-8e8d-c5e4a57b3e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Volume 178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf', 'volume_size': 1, 'image_id': '7332610d-b4b1-4ab3-a768-204c4149bc0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7332610d-b4b1-4ab3-a768-204c4149bc0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b2c17802e9bdbf0aa1f52943ca38caa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '940c3c228656413ba3fd715c31bd9ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '676bf539db6daeeb63e3114e93db344bcf5aa7fbd7c4e9077eede44d89f6cced9351c1bedb7a807cceb62f9d902e9e8519aaafb1a34a4af166758957a3d85040', 'id': '7332610d-b4b1-4ab3-a768-204c4149bc0b', 'created_at': datetime.datetime(2026, 7, 17, 13, 45, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 45, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7332610d-b4b1-4ab3-a768-204c4149bc0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Trying to clone 178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf from image 7332610d-b4b1-4ab3-a768-204c4149bc0b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7332610d-b4b1-4ab3-a768-204c4149bc0b', 'metadata': {}}]). {{(pid=87769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72" returned: 0 in 0.302s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.756s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2117432436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9970a4-2a9d-4fbe-8702-1138c08d9da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badf37b71f484bdfb8c0154b612068c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:47Z,use_quota=True,user_id='54640360803f4271bda237be93b46606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Creating volume dd9970a4-2a9d-4fbe-8702-1138c08d9da1 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:50 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 1073741824 Jul 17 15:45:50 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30479de-5770-4e00-b864-ac0994fd8975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd2f344-ef88-4546-9399-a6308ff9bf72', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fd20cd-2b9b-4bd2-8b2a-868244efc84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Volume volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 (9cd2f344-ef88-4546-9399-a6308ff9bf72): created successfully Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fd20cd-2b9b-4bd2-8b2a-868244efc84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (1c6dc7b5-23e1-41dc-b49c-35f7f8ac388d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:50 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD Jul 17 15:45:50 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5024afb8-4777-4215-b367-e992cd69c3fa tempest-CreateVolumesFromImageTest-1388975527 None] Created volume successfully. Jul 17 15:45:50 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 15:45:50 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Image download 0.00 MB at 0.00 MB/s Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3236b92-1fab-4067-af32-026277a5a9bd]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:51 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD" returned: 1 in 0.415s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:51 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:45:51 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Temporary image a887e36f-01e4-48bd-9234-a196d275cd3c is fetched for user 8dd58d1cb061450c8b22f63fc610c5d8. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c0490-cff8-4b80-bc2e-833977bc2c34]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:51 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 1073741824" returned: 0 in 0.574s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:51 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD Jul 17 15:45:51 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:51 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:51 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 Jul 17 15:45:51 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:51 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD Jul 17 15:45:51 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:51 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:51 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.890s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128422253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b42a43-2326-4c62-a8e8-b55889968995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:48Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Creating volume c8b42a43-2326-4c62-a8e8-b55889968995 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:51 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39863e6f-f951-4b96-8dad-1e7e89dff124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:51 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995 1073741824 Jul 17 15:45:51 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09097e2-4d5e-4866-ba29-1cd8cc2ed3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Volume volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 (dd9970a4-2a9d-4fbe-8702-1138c08d9da1): created successfully Jul 17 15:45:51 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD Jul 17 15:45:51 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09097e2-4d5e-4866-ba29-1cd8cc2ed3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Flow 'volume_create_manager' (917755d3-cc8e-4f3a-9fae-6eb344241a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:51 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:51 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-932f0559-3d3e-435a-b8a4-675397f42e03 tempest-CreateVolumesFromImageTest-1388975527 None] Created volume successfully. Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Temporary image 7332610d-b4b1-4ab3-a768-204c4149bc0b is fetched for user a4827af9407a4a51b862441ce48b7d03. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6ce334-3221-4690-9ba2-679da3367f3a]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:51 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD Jul 17 15:45:51 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:51 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:45:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-dd9970a4-2a9d-4fbe-8702-1138c08d9da1-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-dd9970a4-2a9d-4fbe-8702-1138c08d9da1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-quobyte-dd9970a4-2a9d-4fbe-8702-1138c08d9da1" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-dd9970a4-2a9d-4fbe-8702-1138c08d9da1" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:52 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbc7e75-56b6-4293-b316-d281aae0c02b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:52 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995 1073741824" returned: 0 in 0.593s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:52 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995 Jul 17 15:45:52 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:52 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD Jul 17 15:45:52 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:52 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 Jul 17 15:45:52 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:52 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:52 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.197s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696440254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9585c9-797f-4991-ad53-fd6648302dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:48Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Creating volume 5f9585c9-797f-4991-ad53-fd6648302dfc {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:52 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:52 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc 1073741824 Jul 17 15:45:52 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de42c7ff-c1de-422c-a99a-69b8997ebae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b42a43-2326-4c62-a8e8-b55889968995', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:52 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ebc624-c1d4-49d2-80d9-07046925fa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1" returned: 0 in 0.384s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:52 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume volume-c8b42a43-2326-4c62-a8e8-b55889968995 (c8b42a43-2326-4c62-a8e8-b55889968995): created successfully Jul 17 15:45:52 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1 Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ebc624-c1d4-49d2-80d9-07046925fa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:52 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (85c47d15-190d-4aca-ac7d-79fb3a94c0e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d9c023e8-26bc-47e6-a9c3-a9fea7351757 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created volume successfully. Jul 17 15:45:52 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dd9970a4-2a9d-4fbe-8702-1138c08d9da1" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-dd9970a4-2a9d-4fbe-8702-1138c08d9da1" released by "delete_volume" :: held 0.701s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:52 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Created reservations ['1dd3f48c-ea93-4cdd-a270-9238a8136d03', '719f057b-d315-443e-97a3-b879defe6f5f', '2aa63011-3cf7-4f54-9b31-5d811863ba9f', '9db11169-25c1-430e-a661-521b5e62acb0'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:53 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc 1073741824" returned: 0 in 0.466s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:53 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:53 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:53 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc Jul 17 15:45:53 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:53 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-9cd2f344-ef88-4546-9399-a6308ff9bf72-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.276s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:45:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Deleted volume successfully. Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-9cd2f344-ef88-4546-9399-a6308ff9bf72-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:53 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc" returned: 0 in 0.274s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2ac08201-1b9d-4a5c-afb8-e675dc8450e2 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-dd9970a4-2a9d-4fbe-8702-1138c08d9da1-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.192s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056551296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05376d4-c772-4578-b376-14eaea08c604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:49Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Creating volume c05376d4-c772-4578-b376-14eaea08c604 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:53 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:53 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604 1073741824 Jul 17 15:45:53 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7f279c-c0d3-4603-a53f-69bf0bd039e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9585c9-797f-4991-ad53-fd6648302dfc', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43b1dcd-d372-4b01-b569-5ccac182e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-quobyte-9cd2f344-ef88-4546-9399-a6308ff9bf72" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:53 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume volume-5f9585c9-797f-4991-ad53-fd6648302dfc (5f9585c9-797f-4991-ad53-fd6648302dfc): created successfully Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43b1dcd-d372-4b01-b569-5ccac182e4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (d2a9b7e1-dbb2-4c26-88a0-397cc6e95cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-9cd2f344-ef88-4546-9399-a6308ff9bf72" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-90792b53-e4d8-4c14-af12-39d5259aca9d tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created volume successfully. Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[03866ad7-a073-4769-9a16-a6ab0e043de8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:53 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 Jul 17 15:45:53 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:53 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604 1073741824" returned: 0 in 0.445s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:53 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604 Jul 17 15:45:53 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:53 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72" returned: 0 in 0.395s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:53 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72 Jul 17 15:45:53 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:54 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604" returned: 0 in 0.270s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.123s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-645254911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2b826a-3ad7-4962-b4b8-532a8b86a962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:50Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Creating volume bc2b826a-3ad7-4962-b4b8-532a8b86a962 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:54 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26531daa-a837-4499-b236-1fe06a072cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05376d4-c772-4578-b376-14eaea08c604', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa0b976-9a6f-4d33-bcf1-271c03b392b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:54 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 1073741824 Jul 17 15:45:54 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:54 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume volume-c05376d4-c772-4578-b376-14eaea08c604 (c05376d4-c772-4578-b376-14eaea08c604): created successfully Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa0b976-9a6f-4d33-bcf1-271c03b392b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (02ad0ef0-b07d-4948-9c93-f51176a71beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:54 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-9cd2f344-ef88-4546-9399-a6308ff9bf72" returned: 0 in 0.266s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5319d5f8-1bce-44ed-be8d-ce5185bfee80 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created volume successfully. Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-9cd2f344-ef88-4546-9399-a6308ff9bf72" released by "delete_volume" :: held 0.708s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Created reservations ['121717d6-b734-44e2-a257-554d1d513abd', '51cc3e1b-4299-47a0-9c0f-d781a62d7157', 'c4238ab0-335f-4689-a3ef-2672f852c9b2', '8802dc49-1b66-4f0a-9eef-c2e805bce24b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:54 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:54 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-c943015d-5808-49f5-b7ce-6dc34d332462-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-c943015d-5808-49f5-b7ce-6dc34d332462-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-quobyte-c943015d-5808-49f5-b7ce-6dc34d332462" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-c943015d-5808-49f5-b7ce-6dc34d332462" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb116b5-db69-4995-9b57-492bc4b0c8b3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:54 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 1073741824" returned: 0 in 0.540s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:54 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.355s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:45:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Deleted volume successfully. Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0158e305-55a0-4240-b7df-2be3600b0a62 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-9cd2f344-ef88-4546-9399-a6308ff9bf72-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:54 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462 Jul 17 15:45:54 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:54 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 Jul 17 15:45:54 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:54 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962" returned: 0 in 0.252s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.842s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-428262938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08259a45-93b4-4dc7-929c-389e6618668e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61b322f34a45c89d7158c8ca3d7c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:50Z,use_quota=True,user_id='34ad4100bdd049c3a8ac22d4068fdb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Creating volume 08259a45-93b4-4dc7-929c-389e6618668e {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:54 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:55 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462" returned: 0 in 0.403s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:55 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e 1073741824 Jul 17 15:45:55 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5237468-dc3a-4a90-b96c-858dbafc93bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:55 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462 Jul 17 15:45:55 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd1f76e-6a6b-464e-b117-c1c7ee2f29f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:55 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 (bc2b826a-3ad7-4962-b4b8-532a8b86a962): created successfully Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd1f76e-6a6b-464e-b117-c1c7ee2f29f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (631dd3d5-310a-444b-ad5c-52d9abb7cb8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8624f09f-a1c0-412d-b544-18b852d1c06b tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created volume successfully. Jul 17 15:45:55 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c943015d-5808-49f5-b7ce-6dc34d332462" returned: 0 in 0.274s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-c943015d-5808-49f5-b7ce-6dc34d332462" released by "delete_volume" :: held 0.728s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Created reservations ['81a5ebc1-d73a-46cb-8480-decb808fd990', 'ff318314-62fe-4f2e-9bef-ad076f523db7', 'eb3da678-26b6-4396-97e6-e5861c863069', '8477dd0d-84fa-425c-b465-af2b1f691d3f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:55 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e 1073741824" returned: 0 in 0.442s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:55 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:55 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:55 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e Jul 17 15:45:55 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:55 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:45:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Deleted volume successfully. Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aef48e69-a7a9-4e08-93d9-3ca8c487fad6 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-c943015d-5808-49f5-b7ce-6dc34d332462-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:55 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e" returned: 0 in 0.291s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.799s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05532d31-89d1-4a2b-91a5-add72ba8ad9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374f2d0d210041c6adedad194612291a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:49Z,use_quota=True,user_id='8dd58d1cb061450c8b22f63fc610c5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Creating volume 05532d31-89d1-4a2b-91a5-add72ba8ad9c {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:55 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:55 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c 1073741824 Jul 17 15:45:55 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d00b8ef-f44e-4fa5-8af5-ec90cae46782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08259a45-93b4-4dc7-929c-389e6618668e', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63463c90-f01a-4b48-9f75-bf34a44ebfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:55 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Volume volume-08259a45-93b4-4dc7-929c-389e6618668e (08259a45-93b4-4dc7-929c-389e6618668e): created successfully Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63463c90-f01a-4b48-9f75-bf34a44ebfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Flow 'volume_create_manager' (659108ec-4183-4ebe-a544-dc54f746dd6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ff2ba2e8-8ad4-480d-b10c-85c033340043 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created volume successfully. Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-quobyte-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed63f3f4-4ab5-46e2-9ea6-2986f764b642]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:56 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 Jul 17 15:45:56 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:56 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c 1073741824" returned: 0 in 0.453s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:56 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c Jul 17 15:45:56 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-08259a45-93b4-4dc7-929c-389e6618668e-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:56 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5" returned: 0 in 0.416s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-08259a45-93b4-4dc7-929c-389e6618668e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:56 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5 Jul 17 15:45:56 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-quobyte-08259a45-93b4-4dc7-929c-389e6618668e" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-08259a45-93b4-4dc7-929c-389e6618668e" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f44a5-1f0a-4855-9f9a-6efc547952cc]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:56 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c" returned: 0 in 0.305s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:56 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e Jul 17 15:45:56 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940c3c228656413ba3fd715c31bd9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:45:50Z,use_quota=True,user_id='a4827af9407a4a51b862441ce48b7d03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e28bdca8-39dd-45f8-8ebe-83484da70f74),volume_type_id=e28bdca8-39dd-45f8-8ebe-83484da70f74)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Creating volume 178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:45:56 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:56 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5" returned: 0 in 0.279s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:56 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf 1073741824 Jul 17 15:45:56 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5" released by "delete_volume" :: held 0.740s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Attempting download of a887e36f-01e4-48bd-9234-a196d275cd3c ((None, [{'url': 'file:///opt/stack/data/glance/images/a887e36f-01e4-48bd-9234-a196d275cd3c', 'metadata': {}}])) to volume 05532d31-89d1-4a2b-91a5-add72ba8ad9c. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Created reservations ['2b7b2df2-1401-4037-9160-e1be20d1a78c', 'd73108f9-fa60-4ae3-8085-3e28eae6cb4d', 'd6c4b7b6-65fd-46ce-b75d-2c88751c27bd', '1c46f9f2-c4c6-41f8-8073-f856f44fa39c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35376cd-3b71-4092-9a68-755565ed93e5]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a887e36f-01e4-48bd-9234-a196d275cd3c_olpcoiws {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:56 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:56 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:56 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e" returned: 0 in 0.477s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:56 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e Jul 17 15:45:56 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:57 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a887e36f-01e4-48bd-9234-a196d275cd3c_olpcoiws Jul 17 15:45:57 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-b38ad805-16ef-4fd7-8821-e96caa54f616-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-b38ad805-16ef-4fd7-8821-e96caa54f616-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "cinder-quobyte-b38ad805-16ef-4fd7-8821-e96caa54f616" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-b38ad805-16ef-4fd7-8821-e96caa54f616" acquired by "delete_volume" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:57 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.342s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:45:57 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Deleted volume successfully. Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea72ef9-e573-4233-a584-b9ea9215bb61]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:57 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf 1073741824" returned: 0 in 0.629s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7fc4cf61-6fe4-4813-b3ff-d2ec74fc5b47 tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-6932cf8c-ce8b-4116-8b6d-ae8633e0a9c5-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:57 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf Jul 17 15:45:57 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:57 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a887e36f-01e4-48bd-9234-a196d275cd3c_olpcoiws" returned: 0 in 0.572s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:57 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a887e36f-01e4-48bd-9234-a196d275cd3c_olpcoiws {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:57 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616 Jul 17 15:45:57 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-08259a45-93b4-4dc7-929c-389e6618668e" returned: 0 in 0.412s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-08259a45-93b4-4dc7-929c-389e6618668e" released by "delete_volume" :: held 0.940s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created reservations ['d78d2691-ca07-4530-93b9-711736aee7b2', 'dce79f1b-7d20-4232-b876-c66054f9dc28', 'ec4c4b2d-a7a3-4c00-b646-aaa12c2c29ed', '8aa9c51b-cd38-423b-9611-f181e025aae9'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:57 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a887e36f-01e4-48bd-9234-a196d275cd3c_olpcoiws Jul 17 15:45:57 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:57 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:57 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:57 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf" returned: 0 in 0.329s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:57 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616" returned: 0 in 0.438s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Attempting download of 7332610d-b4b1-4ab3-a768-204c4149bc0b ((None, [{'url': 'file:///opt/stack/data/glance/images/7332610d-b4b1-4ab3-a768-204c4149bc0b', 'metadata': {}}])) to volume 178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 15:45:57 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616 Jul 17 15:45:57 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5dd8e6-94be-4224-a630-8b3e4e2e7f54]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7332610d-b4b1-4ab3-a768-204c4149bc0b_u5mo5hxh {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:57 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a887e36f-01e4-48bd-9234-a196d275cd3c_olpcoiws" returned: 1 in 0.407s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a887e36f-01e4-48bd-9234-a196d275cd3c_olpcoiws' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa06b65-fe99-4646-893e-21b1a39c788b]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:57 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.291s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:45:57 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Deleted volume successfully. Jul 17 15:45:57 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7332610d-b4b1-4ab3-a768-204c4149bc0b_u5mo5hxh Jul 17 15:45:57 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:57 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD Jul 17 15:45:57 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-d51d889d-e182-4be2-9daa-c04bb1e9e82c tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-08259a45-93b4-4dc7-929c-389e6618668e-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:57 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b38ad805-16ef-4fd7-8821-e96caa54f616" returned: 0 in 0.331s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-quobyte-b38ad805-16ef-4fd7-8821-e96caa54f616" released by "delete_volume" :: held 0.835s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Created reservations ['921570cb-69ff-4c1d-b4a6-0a4b581f8f9a', '25df96f7-c43f-471c-8ab4-fa753044075a', '71fad517-fae1-45c0-9f7d-4ae8c46d4086', '8605c292-e5a1-43e5-afc9-e21dc8476698'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:58 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7332610d-b4b1-4ab3-a768-204c4149bc0b_u5mo5hxh" returned: 0 in 0.423s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7332610d-b4b1-4ab3-a768-204c4149bc0b_u5mo5hxh {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:58 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:58 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:58 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:58 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7332610d-b4b1-4ab3-a768-204c4149bc0b_u5mo5hxh Jul 17 15:45:58 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:58 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD Jul 17 15:45:58 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:58 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:58 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.301s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7332610d-b4b1-4ab3-a768-204c4149bc0b_u5mo5hxh" returned: 1 in 0.369s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7332610d-b4b1-4ab3-a768-204c4149bc0b_u5mo5hxh' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c65437-6b86-46e2-86f2-3c68ac6cca51]: (4, 'raw') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Deleted volume successfully. Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:58 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD" returned: 1 in 0.393s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] a887e36f-01e4-48bd-9234-a196d275cd3c was raw, converting to qcow2 {{(pid=87769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-910c0121-39d8-4073-8cd7-979240004c7e tempest-CreateVolumesFromImageTest-1388975527 None] Lock "cinder-b38ad805-16ef-4fd7-8821-e96caa54f616-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:58 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c Jul 17 15:45:58 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-bc2b826a-3ad7-4962-b4b8-532a8b86a962-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-bc2b826a-3ad7-4962-b4b8-532a8b86a962-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:58 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD Jul 17 15:45:58 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-quobyte-bc2b826a-3ad7-4962-b4b8-532a8b86a962" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-bc2b826a-3ad7-4962-b4b8-532a8b86a962" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebf3ed5-9929-46ed-9270-433128d58e0d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:45:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:58 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 Jul 17 15:45:58 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:59 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:59 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD Jul 17 15:45:59 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:59 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c" returned: 0 in 0.637s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a887e36f-01e4-48bd-9234-a196d275cd3c_k8kijig4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:45:59 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:59 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c 1G Jul 17 15:45:59 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:59 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962" returned: 0 in 0.496s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:59 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962 Jul 17 15:45:59 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:59 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] 7332610d-b4b1-4ab3-a768-204c4149bc0b was raw, converting to qcow2 {{(pid=87769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:59 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf Jul 17 15:45:59 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:59 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bc2b826a-3ad7-4962-b4b8-532a8b86a962" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-bc2b826a-3ad7-4962-b4b8-532a8b86a962" released by "delete_volume" :: held 0.839s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:45:59 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c 1G" returned: 0 in 0.418s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Downloaded image a887e36f-01e4-48bd-9234-a196d275cd3c ((None, [{'url': 'file:///opt/stack/data/glance/images/a887e36f-01e4-48bd-9234-a196d275cd3c', 'metadata': {}}])) to volume 05532d31-89d1-4a2b-91a5-add72ba8ad9c successfully. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Temporary image a887e36f-01e4-48bd-9234-a196d275cd3c for user 8dd58d1cb061450c8b22f63fc610c5d8 is deleted. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Marking volume 05532d31-89d1-4a2b-91a5-add72ba8ad9c as bootable. {{(pid=87769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Copying metadata from image a887e36f-01e4-48bd-9234-a196d275cd3c to 05532d31-89d1-4a2b-91a5-add72ba8ad9c. {{(pid=87769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Creating volume glance metadata for volume 05532d31-89d1-4a2b-91a5-add72ba8ad9c backed by image a887e36f-01e4-48bd-9234-a196d275cd3c with: {'image_id': 'a887e36f-01e4-48bd-9234-a196d275cd3c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '227268eb1959cd1d77e64d14029c1f4e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created reservations ['6d6c045f-ceae-447e-9546-1e73da916b27', 'dee0e32f-5ad3-4884-a003-6d0f0f26a993', 'd516c719-a155-4eb4-8995-394041bf3654', '035b676a-1f04-45b9-924e-258d51d784c3'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecbd3d7-b945-46b6-98ac-a2519f3a73f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c', 'volume_size': 1, 'image_id': 'a887e36f-01e4-48bd-9234-a196d275cd3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a887e36f-01e4-48bd-9234-a196d275cd3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '227268eb1959cd1d77e64d14029c1f4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '374f2d0d210041c6adedad194612291a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '858bfd4b00a170aaa54e4186514a2b3cee6976401ff8a0e4134de7a9ddb1779af34a62cff6f6bb2abd0020d83c8b7f2c872d48f79e5c908792feece2e4a23a01', 'id': 'a887e36f-01e4-48bd-9234-a196d275cd3c', 'created_at': datetime.datetime(2026, 7, 17, 13, 45, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 45, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a887e36f-01e4-48bd-9234-a196d275cd3c/file', 'properties': {}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d61d69c-0aea-4953-936a-e734b901dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:45:59 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Volume volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c (05532d31-89d1-4a2b-91a5-add72ba8ad9c): created successfully Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d61d69c-0aea-4953-936a-e734b901dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Flow 'volume_create_manager' (af328013-c1ae-4622-897e-51a4c6e2c277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:45:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-50076a13-a5a5-4c0a-ae32-3f0b71ba2ca0 tempest-VolumeImageDependencyTests-763394895 None] Created volume successfully. Jul 17 15:45:59 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:45:59 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-c05376d4-c772-4578-b376-14eaea08c604-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:45:59 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-c05376d4-c772-4578-b376-14eaea08c604-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-quobyte-c05376d4-c772-4578-b376-14eaea08c604" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-c05376d4-c772-4578-b376-14eaea08c604" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[17917768-0bc4-480f-8b75-610aad5d5e89]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:00 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf" returned: 0 in 0.694s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7332610d-b4b1-4ab3-a768-204c4149bc0b_c9rv7fwsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:46:00 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:00 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.368s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:00 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf 1G Jul 17 15:46:00 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Deleted volume successfully. Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ea9e28a7-068f-40e2-8d91-b23037249497 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-bc2b826a-3ad7-4962-b4b8-532a8b86a962-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:00 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604 Jul 17 15:46:00 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Acquiring lock "cinder-05532d31-89d1-4a2b-91a5-add72ba8ad9c-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Lock "cinder-05532d31-89d1-4a2b-91a5-add72ba8ad9c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Acquiring lock "cinder-quobyte-05532d31-89d1-4a2b-91a5-add72ba8ad9c" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Lock "cinder-quobyte-05532d31-89d1-4a2b-91a5-add72ba8ad9c" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1bb479-0279-4a6f-a10e-4f9ac0e0b501]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:00 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c Jul 17 15:46:00 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:00 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604" returned: 0 in 0.517s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:00 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf 1G" returned: 0 in 0.436s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Downloaded image 7332610d-b4b1-4ab3-a768-204c4149bc0b ((None, [{'url': 'file:///opt/stack/data/glance/images/7332610d-b4b1-4ab3-a768-204c4149bc0b', 'metadata': {}}])) to volume 178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf successfully. {{(pid=87769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Temporary image 7332610d-b4b1-4ab3-a768-204c4149bc0b for user a4827af9407a4a51b862441ce48b7d03 is deleted. {{(pid=87769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.volume.volume_utils [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Marking volume 178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf as bootable. {{(pid=87769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 15:46:00 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604 Jul 17 15:46:00 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Copying metadata from image 7332610d-b4b1-4ab3-a768-204c4149bc0b to 178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf. {{(pid=87769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Creating volume glance metadata for volume 178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf backed by image 7332610d-b4b1-4ab3-a768-204c4149bc0b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7332610d-b4b1-4ab3-a768-204c4149bc0b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0b2c17802e9bdbf0aa1f52943ca38caa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c80a584-066b-43cb-8e8d-c5e4a57b3e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf', 'volume_size': 1, 'image_id': '7332610d-b4b1-4ab3-a768-204c4149bc0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7332610d-b4b1-4ab3-a768-204c4149bc0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b2c17802e9bdbf0aa1f52943ca38caa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '940c3c228656413ba3fd715c31bd9ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '676bf539db6daeeb63e3114e93db344bcf5aa7fbd7c4e9077eede44d89f6cced9351c1bedb7a807cceb62f9d902e9e8519aaafb1a34a4af166758957a3d85040', 'id': '7332610d-b4b1-4ab3-a768-204c4149bc0b', 'created_at': datetime.datetime(2026, 7, 17, 13, 45, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 13, 45, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7332610d-b4b1-4ab3-a768-204c4149bc0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaa907a-36bd-432e-9edb-bb08aaf9f8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:00 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Volume volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf (178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf): created successfully Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaa907a-36bd-432e-9edb-bb08aaf9f8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Flow 'volume_create_manager' (47e30ada-8735-4d49-96b9-65d63fe2c7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-97349a94-7b18-4244-afa7-2485f29635f8 tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Created volume successfully. Jul 17 15:46:00 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c" returned: 0 in 0.433s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:00 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c05376d4-c772-4578-b376-14eaea08c604" returned: 0 in 0.312s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:00 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c Jul 17 15:46:00 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-c05376d4-c772-4578-b376-14eaea08c604" released by "delete_volume" :: held 0.879s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:00 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created reservations ['a4323ce6-f786-4eee-8f31-50171623e7d0', '683040b4-8858-48f4-980c-ea1db4b8502f', '2140ca5d-c008-4b92-b001-67cc2d7cd1f8', '853b5e1e-1dc0-4249-9703-35321a9bcd55'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:01 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:01 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-5f9585c9-797f-4991-ad53-fd6648302dfc-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-5f9585c9-797f-4991-ad53-fd6648302dfc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Acquiring lock "cinder-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:01 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-05532d31-89d1-4a2b-91a5-add72ba8ad9c" returned: 0 in 0.390s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "cinder-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-quobyte-5f9585c9-797f-4991-ad53-fd6648302dfc" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Lock "cinder-quobyte-05532d31-89d1-4a2b-91a5-add72ba8ad9c" released by "delete_volume" :: held 0.917s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-5f9585c9-797f-4991-ad53-fd6648302dfc" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9250b999-7022-482a-a9c5-c82ad8e7e6dc]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Acquiring lock "cinder-quobyte-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "cinder-quobyte-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf" acquired by "delete_volume" :: waited 0.037s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Created reservations ['3028c87c-4ee2-4b60-b0a5-4f85c36fc1fd', '7a209364-db92-463d-b190-511833e63a9c', '00498452-dd42-494b-bed4-79439c826ddd', '65a7fc17-4154-414d-be05-6af1eb98590f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:01 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.422s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f7f2e0-79d5-478a-861d-99b1cbd595f5]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:01 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Deleted volume successfully. Jul 17 15:46:01 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc Jul 17 15:46:01 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-717f46f8-ab47-44de-af62-92adc87d0c96 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-c05376d4-c772-4578-b376-14eaea08c604-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:01 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf Jul 17 15:46:01 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:01 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:01 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:01 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc" returned: 0 in 0.577s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:01 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc Jul 17 15:46:01 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:02 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.406s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Deleted volume successfully. Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:02 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Flow 'volume_create_manager' (76617946-4d5a-4034-afb3-f5c7d9d2ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329613c5-48af-42d8-9973-b972329f5a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf" returned: 0 in 0.644s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:02 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329613c5-48af-42d8-9973-b972329f5a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-893753326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c5244b-3c5e-4413-b4f8-c8866f332880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a15f5796724e6282b19b51b8e130e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:02Z,use_quota=True,user_id='31213c3a1807455ca3608f45fffe72e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:02 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dee6762-58a8-4c44-b3b3-42cf48ba19a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dee6762-58a8-4c44-b3b3-42cf48ba19a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9b09db-b0e8-49b6-ba21-4466040736e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9b09db-b0e8-49b6-ba21-4466040736e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c5244b-3c5e-4413-b4f8-c8866f332880', 'volume_name': 'volume-94c5244b-3c5e-4413-b4f8-c8866f332880', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984b4625-c8b5-4263-bce9-47acd2319854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984b4625-c8b5-4263-bce9-47acd2319854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0581a8c-c311-464d-bf73-4fd695a59244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:02 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Volume 94c5244b-3c5e-4413-b4f8-c8866f332880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c5244b-3c5e-4413-b4f8-c8866f332880', 'volume_size': 1} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-893753326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c5244b-3c5e-4413-b4f8-c8866f332880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a15f5796724e6282b19b51b8e130e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:02Z,use_quota=True,user_id='31213c3a1807455ca3608f45fffe72e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Creating volume 94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:02 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a7e2cb14-42d2-4c3e-b637-ad60ad78c219 tempest-VolumeImageDependencyTests-763394895 None] Lock "cinder-05532d31-89d1-4a2b-91a5-add72ba8ad9c-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:02 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 1073741824 Jul 17 15:46:02 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:02 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f9585c9-797f-4991-ad53-fd6648302dfc" returned: 0 in 0.331s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-5f9585c9-797f-4991-ad53-fd6648302dfc" released by "delete_volume" :: held 0.985s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created reservations ['d4a626f3-21c4-4cad-a647-528e0553fa14', 'be046a85-0d8f-499f-8dec-cef56be5d4f6', '2bd41578-e922-4e1e-b95a-c24f2af62381', '814133e9-4ee2-4b55-b1ed-cab0a570408a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:02 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf" returned: 0 in 0.318s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "cinder-quobyte-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf" released by "delete_volume" :: held 1.048s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:02 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:02 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Created reservations ['6e67352f-0804-42b3-93f2-92c99ea009dc', 'f0779649-6ed6-4f3c-a698-ce16b510e63a', '7f9072d3-77e3-4b24-ab08-7514593a6048', '0defa118-a73a-4110-a61e-a8aa691219bf'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:02 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:02 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:02 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.293s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:02 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Deleted volume successfully. Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 1073741824" returned: 0 in 0.545s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-590824b2-95d6-4bd3-8061-c38087393c81 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-5f9585c9-797f-4991-ad53-fd6648302dfc-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:02 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 Jul 17 15:46:02 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:02 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.289s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Deleted volume successfully. Jul 17 15:46:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-3411d326-4cb3-4cc0-b684-9f6cacaaf2bd tempest-VolumeAndVolumeTypeFromImageTest-2073986530 None] Lock "cinder-178d7a42-d7d1-49b9-84bc-c5dbcd0c50cf-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:03 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0581a8c-c311-464d-bf73-4fd695a59244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c5244b-3c5e-4413-b4f8-c8866f332880', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1da5ef5-cd2f-478d-ac83-b1b5a0421af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:03 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Volume volume-94c5244b-3c5e-4413-b4f8-c8866f332880 (94c5244b-3c5e-4413-b4f8-c8866f332880): created successfully Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1da5ef5-cd2f-478d-ac83-b1b5a0421af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Flow 'volume_create_manager' (76617946-4d5a-4034-afb3-f5c7d9d2ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:03 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-814a75a8-318d-4446-86e0-5adeaaba93ef tempest-VolumeDependencyTests-291930445 None] Created volume successfully. Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-c8b42a43-2326-4c62-a8e8-b55889968995-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-c8b42a43-2326-4c62-a8e8-b55889968995-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-quobyte-c8b42a43-2326-4c62-a8e8-b55889968995" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-c8b42a43-2326-4c62-a8e8-b55889968995" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d0c389-919e-4a72-8285-854dc972e8b1]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:03 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995 Jul 17 15:46:03 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:04 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995" returned: 0 in 0.462s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:04 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995 Jul 17 15:46:04 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:04 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c8b42a43-2326-4c62-a8e8-b55889968995" returned: 0 in 0.349s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-c8b42a43-2326-4c62-a8e8-b55889968995" released by "delete_volume" :: held 0.874s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Creating offline snapshot 8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 of volume 94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcdafe7-b5b2-4a10-925f-96330cde87ee]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created reservations ['12036be1-4ec9-421b-b635-ee902f2ecccc', 'd4680e6c-668f-405d-936f-052a7f15aa51', '4637af51-d407-46fc-9dfe-e1e2b6cba0f5', '9002793a-c4d9-43b7-b51c-bb3c5af179c6'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:04 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 Jul 17 15:46:04 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:04 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:04 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-d50de305-bead-46c1-9845-3525dd446789-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-d50de305-bead-46c1-9845-3525dd446789-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "cinder-quobyte-d50de305-bead-46c1-9845-3525dd446789" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-d50de305-bead-46c1-9845-3525dd446789" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a4fea3-5d33-48f0-8ab9-eea5786065e5]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:04 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880" returned: 0 in 0.490s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:05 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 1G Jul 17 15:46:05 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:05 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.451s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:05 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789 Jul 17 15:46:05 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:05 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Deleted volume successfully. Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-76392d74-4baf-4d81-a9e1-558634b49e85 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-c8b42a43-2326-4c62-a8e8-b55889968995-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:05 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789" returned: 0 in 0.593s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:05 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789 Jul 17 15:46:05 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:05 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 1G" returned: 0 in 0.553s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c5244b-3c5e-4413-b4f8-c8866f332880 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:05 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c5244b-3c5e-4413-b4f8-c8866f332880 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 Jul 17 15:46:05 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:05 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d50de305-bead-46c1-9845-3525dd446789" returned: 0 in 0.276s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-quobyte-d50de305-bead-46c1-9845-3525dd446789" released by "delete_volume" :: held 0.946s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Created reservations ['bc230aa0-eba6-491c-9443-9af48dafc71e', '1b2a5f6e-6f08-4b4e-921e-4d7f0481b4a7', '7c24b83f-fa0d-4ecf-a5c0-e462c51e8d5a', '9e9c2668-31f1-4692-8762-d0ff885e01f9'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:05 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c5244b-3c5e-4413-b4f8-c8866f332880 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03" returned: 0 in 0.402s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:05 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 is being set with open permissions: ugo+rw Jul 17 15:46:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:05 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 Jul 17 15:46:05 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:06 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:06 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:06 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03" returned: 0 in 0.399s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:06 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.info Jul 17 15:46:06 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:06 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.458s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Deleted volume successfully. Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1c316dca-8df5-4691-b6e2-695c16c17929 tempest-CreateVolumesFromSourceVolumeTest-747530793 None] Lock "cinder-d50de305-bead-46c1-9845-3525dd446789-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Flow 'volume_create_manager' (96e3f8e2-8848-4bc8-a1fc-5509b8c8e316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2831d874-42f3-4fcf-8fec-a58fefc3a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2831d874-42f3-4fcf-8fec-a58fefc3a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a84066-1d98-42bc-b6af-90e6444a2166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4e39561dbd4c83aeee5d546076a313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:07Z,use_quota=True,user_id='0c323b3d89254cd39526797ab7051d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30497d8f-82f6-4947-9e02-25dcdd6ef31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30497d8f-82f6-4947-9e02-25dcdd6ef31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a383a3-4b7d-48df-9f46-27794470463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a383a3-4b7d-48df-9f46-27794470463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a84066-1d98-42bc-b6af-90e6444a2166', 'volume_name': 'volume-42a84066-1d98-42bc-b6af-90e6444a2166', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8be96ec-adbc-42dc-9456-cdda127d8dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8be96ec-adbc-42dc-9456-cdda127d8dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcb3efb-b4ba-40bf-9897-94bc381688d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:06 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Volume 42a84066-1d98-42bc-b6af-90e6444a2166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a84066-1d98-42bc-b6af-90e6444a2166', 'volume_size': 1} Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:06 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.info" returned: 0 in 0.357s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:06 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.info is being set with open permissions: ugo+rw Jul 17 15:46:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:06 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.info Jul 17 15:46:06 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:07 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.info" returned: 0 in 0.279s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a84066-1d98-42bc-b6af-90e6444a2166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4e39561dbd4c83aeee5d546076a313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:07Z,use_quota=True,user_id='0c323b3d89254cd39526797ab7051d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Creating volume 42a84066-1d98-42bc-b6af-90e6444a2166 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:07 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:07 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166 1073741824 Jul 17 15:46:07 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:07 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-3e2eaf57-7cf0-4299-b766-166fb74eff8a tempest-VolumeDependencyTests-291930445 None] Create snapshot completed successfully Jul 17 15:46:07 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166 1073741824" returned: 0 in 0.621s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:07 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166 Jul 17 15:46:07 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:08 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166" returned: 0 in 0.305s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcb3efb-b4ba-40bf-9897-94bc381688d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a84066-1d98-42bc-b6af-90e6444a2166', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197006cf-5bc5-4f24-832d-b8c85e9f53a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:08 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Volume volume-42a84066-1d98-42bc-b6af-90e6444a2166 (42a84066-1d98-42bc-b6af-90e6444a2166): created successfully Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197006cf-5bc5-4f24-832d-b8c85e9f53a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Flow 'volume_create_manager' (96e3f8e2-8848-4bc8-a1fc-5509b8c8e316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:08 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-93cccce0-e7ea-4e45-ab10-2acf8ab98caf tempest-CinderUnicodeTest-1106331847 None] Created volume successfully. Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Flow 'volume_create_manager' (d34a88cc-59a5-40f4-819d-a243816557dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4255be39-3db7-46ec-990a-d151516ca616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4255be39-3db7-46ec-990a-d151516ca616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-502142943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a13dd6-cd8a-4170-8172-5245c6b71a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a15f5796724e6282b19b51b8e130e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:08Z,use_quota=True,user_id='31213c3a1807455ca3608f45fffe72e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43825d22-52a8-418d-8d8e-0d0c241ed2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43825d22-52a8-418d-8d8e-0d0c241ed2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ae8b83-2644-4f29-b9ce-bb5693d836e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ae8b83-2644-4f29-b9ce-bb5693d836e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9a13dd6-cd8a-4170-8172-5245c6b71a2a', 'volume_name': 'volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a', 'volume_size': 1, 'snapshot_id': '8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e094bb-4432-49b7-a43b-aaf1ecf64490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e094bb-4432-49b7-a43b-aaf1ecf64490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4fcc8c-2731-45bd-a1a9-2b29b5583d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:08 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Volume b9a13dd6-cd8a-4170-8172-5245c6b71a2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a', 'volume_size': 1, 'snapshot_id': '8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03'} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "cinder-quobyte-8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" by "_create_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Creating volume b9a13dd6-cd8a-4170-8172-5245c6b71a2a from snapshot 8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 {{(pid=87769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "cinder-quobyte-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] snapshot: 8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03, volume: b9a13dd6-cd8a-4170-8172-5245c6b71a2a, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efb51cb-5b07-4316-a75e-9f29914bfb9a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:08 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 Jul 17 15:46:08 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:09 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03" returned: 0 in 0.569s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94c5244b-3c5e-4413-b4f8-c8866f332880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d5c259-290a-47bd-bc99-531acf0100b6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:09 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 Jul 17 15:46:09 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (ee56df99-a317-42ae-b160-93493f1d409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb55b09-7549-4816-bca4-9ee4c43f4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb55b09-7549-4816-bca4-9ee4c43f4011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1606985643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4505079-d5a2-4f85-833c-4938e63ca9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:09Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761fc534-2cb6-42c6-861f-2b65556a21a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761fc534-2cb6-42c6-861f-2b65556a21a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebece27-62af-4d9f-b240-782c2388f69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebece27-62af-4d9f-b240-782c2388f69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4505079-d5a2-4f85-833c-4938e63ca9df', 'volume_name': 'volume-b4505079-d5a2-4f85-833c-4938e63ca9df', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8e76c9-4a61-4979-8773-325e376f032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8e76c9-4a61-4979-8773-325e376f032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cc235d-9201-4433-b9a4-f4cfab1367a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume b4505079-d5a2-4f85-833c-4938e63ca9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4505079-d5a2-4f85-833c-4938e63ca9df', 'volume_size': 1} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Flow 'volume_create_manager' (f71e5c10-73dd-47f4-8e4c-06291e46c1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd80eb74-a9fe-44e2-bfe2-f21bbab51846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd80eb74-a9fe-44e2-bfe2-f21bbab51846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-695702888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2e08d3-1e82-4c2e-bb2a-a423290f3160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4e39561dbd4c83aeee5d546076a313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:09Z,use_quota=True,user_id='0c323b3d89254cd39526797ab7051d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cede92b1-8fce-465d-a56c-eb1c361c2bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cede92b1-8fce-465d-a56c-eb1c361c2bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74abb98b-364f-49ac-9d90-4b7134f84748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74abb98b-364f-49ac-9d90-4b7134f84748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2e08d3-1e82-4c2e-bb2a-a423290f3160', 'volume_name': 'volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a8fa60-d3e4-44ae-998e-fb43c6a37a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a8fa60-d3e4-44ae-998e-fb43c6a37a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef77fdb-750c-41c8-b616-9ed35afc6cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:09 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Volume 6b2e08d3-1e82-4c2e-bb2a-a423290f3160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160', 'volume_size': 1} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:09 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880" returned: 0 in 0.416s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:46:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:09 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a Jul 17 15:46:09 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:14 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" returned: 0 in 4.943s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:14 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3c9b30-227e-4bd1-9b4d-9deea0276423]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:14 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 Jul 17 15:46:14 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:15 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880" returned: 0 in 0.526s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880, size 1024.00 MB, duration 4.94 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:46:15 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Converted 1024.00 MB image at 207.12 MB/s Jul 17 15:46:15 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a is being set with open permissions: ugo+rw Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:15 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a Jul 17 15:46:15 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:15 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" returned: 0 in 0.251s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" released by "_copy_volume_from_snapshot" :: held 6.831s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" released by "_create_volume_from_snapshot" :: held 6.874s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.896s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.919s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1606985643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4505079-d5a2-4f85-833c-4938e63ca9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:09Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Creating volume b4505079-d5a2-4f85-833c-4938e63ca9df {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:15 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:15 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df 1073741824 Jul 17 15:46:15 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4fcc8c-2731-45bd-a1a9-2b29b5583d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a', 'volume_size': 1, 'snapshot_id': '8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac45477-49cc-4e89-a30c-d1899c42e461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:15 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Volume volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a (b9a13dd6-cd8a-4170-8172-5245c6b71a2a): created successfully Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac45477-49cc-4e89-a30c-d1899c42e461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Flow 'volume_create_manager' (d34a88cc-59a5-40f4-819d-a243816557dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:15 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-00533eb9-fd56-4c59-a853-edfd86b457f8 tempest-VolumeDependencyTests-291930445 None] Created volume successfully. Jul 17 15:46:15 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df 1073741824" returned: 0 in 0.483s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:15 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df Jul 17 15:46:15 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "cinder-8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "cinder-quobyte-94c5244b-3c5e-4413-b4f8-c8866f332880" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-94c5244b-3c5e-4413-b4f8-c8866f332880" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "cinder-quobyte-8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Deleting offline snapshot 8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 of volume 94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] snapshot_file for this snap is: volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffe4720-c91c-4175-8809-39ef239bf6d7]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:16 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df" returned: 0 in 0.292s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.656s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-695702888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2e08d3-1e82-4c2e-bb2a-a423290f3160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4e39561dbd4c83aeee5d546076a313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:09Z,use_quota=True,user_id='0c323b3d89254cd39526797ab7051d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Creating volume 6b2e08d3-1e82-4c2e-bb2a-a423290f3160 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:16 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cc235d-9201-4433-b9a4-f4cfab1367a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4505079-d5a2-4f85-833c-4938e63ca9df', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:16 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 1073741824 Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b3d1a4-f778-43d7-8327-608cd4cf2d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:16 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:16 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume volume-b4505079-d5a2-4f85-833c-4938e63ca9df (b4505079-d5a2-4f85-833c-4938e63ca9df): created successfully Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b3d1a4-f778-43d7-8327-608cd4cf2d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (ee56df99-a317-42ae-b160-93493f1d409f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-bacf8c3b-a3ed-406f-994c-7d70b9f82c28 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created volume successfully. Jul 17 15:46:16 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 Jul 17 15:46:16 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:16 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03" returned: 0 in 0.370s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94c5244b-3c5e-4413-b4f8-c8866f332880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5d6ad5-b9ae-471d-a638-afbf62f8a66e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:16 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 1073741824" returned: 0 in 0.428s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:16 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 Jul 17 15:46:16 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:16 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 Jul 17 15:46:16 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:16 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" returned: 0 in 0.271s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef77fdb-750c-41c8-b616-9ed35afc6cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7457250b-c523-4853-a0d1-b7e8cc6779c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:16 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:16 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Volume volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 (6b2e08d3-1e82-4c2e-bb2a-a423290f3160): created successfully Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7457250b-c523-4853-a0d1-b7e8cc6779c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Flow 'volume_create_manager' (f71e5c10-73dd-47f4-8e4c-06291e46c1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880" returned: 0 in 0.430s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:17 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4e5cd4bd-6c19-44b0-8ea0-f77cf12dac00 tempest-CinderUnicodeTest-1106331847 None] Created volume successfully. Jul 17 15:46:17 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 Jul 17 15:46:17 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Creating offline snapshot 0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 of volume b4505079-d5a2-4f85-833c-4938e63ca9df {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5866e8-ff67-4b2d-84f0-77771f442b36]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:17 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03" returned: 0 in 0.437s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:17 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df Jul 17 15:46:17 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:17 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03 Jul 17 15:46:17 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:17 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880.8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03" returned: 0 in 0.281s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:17 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df" returned: 0 in 0.480s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03" released by "_delete_snapshot" :: held 1.637s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-94c5244b-3c5e-4413-b4f8-c8866f332880" released by "delete_snapshot" :: held 1.662s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:17 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 1G Jul 17 15:46:17 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Created reservations ['ec91cf11-8b8c-4b6d-8b10-0f40bce57461', '3d43cfcc-d6e3-47ed-b120-2923b44953c1', '089410b7-b10a-411a-8dee-4de0c3aa3d8a', '1e6d0dbe-01da-4b4a-b7f3-01f4ee49c272'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:17 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Delete snapshot completed successfully. Jul 17 15:46:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fd8ea7cf-7377-426c-b695-fbaae0f8efd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-8ee6f988-e6eb-4a5a-93a6-79dd6a9c8a03-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:18 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 1G" returned: 0 in 0.430s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4505079-d5a2-4f85-833c-4938e63ca9df -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:18 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4505079-d5a2-4f85-833c-4938e63ca9df -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 Jul 17 15:46:18 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "cinder-94c5244b-3c5e-4413-b4f8-c8866f332880-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-94c5244b-3c5e-4413-b4f8-c8866f332880-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "cinder-quobyte-94c5244b-3c5e-4413-b4f8-c8866f332880" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-94c5244b-3c5e-4413-b4f8-c8866f332880" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[33194574-8b36-45c5-b327-2f83d211d3fe]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:18 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4505079-d5a2-4f85-833c-4938e63ca9df -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7" returned: 0 in 0.364s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:18 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 is being set with open permissions: ugo+rw Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:18 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 Jul 17 15:46:18 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:18 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 Jul 17 15:46:18 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:18 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7" returned: 0 in 0.280s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:18 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880" returned: 0 in 0.418s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:18 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880 Jul 17 15:46:18 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:18 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.info Jul 17 15:46:18 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:19 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-94c5244b-3c5e-4413-b4f8-c8866f332880" returned: 0 in 0.288s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-94c5244b-3c5e-4413-b4f8-c8866f332880" released by "delete_volume" :: held 0.787s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Created reservations ['76e80190-672e-404a-9aef-58821fe92e27', '6e7219ac-1224-48bc-ba6b-64c22e8b2949', 'e8818917-408d-4973-8a32-dc473dac17c8', '925cc518-cfab-4c2c-bd4d-4c3ec8a11353'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:19 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.info" returned: 0 in 0.337s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:19 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.info is being set with open permissions: ugo+rw Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:19 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.info Jul 17 15:46:19 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:19 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:19 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "cinder-b9a13dd6-cd8a-4170-8172-5245c6b71a2a-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-b9a13dd6-cd8a-4170-8172-5245c6b71a2a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:19 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "cinder-quobyte-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.info" returned: 0 in 0.368s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.107s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:19 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.328s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" acquired by "delete_volume" :: waited 0.047s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:19 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Deleted volume successfully. Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Creating offline snapshot 9976828d-f7ff-49d7-9832-2e643bd3f595 of volume 6b2e08d3-1e82-4c2e-bb2a-a423290f3160 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc44b0c-a736-4d4a-80e0-76e1faa7a97a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c816078-4e1a-4a24-915c-aecb019f26cc]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:19 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1812eaf7-eb72-4beb-8f5c-3732729a9362 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Create snapshot completed successfully Jul 17 15:46:19 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a7febfa-8ba9-4b6c-82f3-27389e7ccdd8 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-94c5244b-3c5e-4413-b4f8-c8866f332880-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:19 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a Jul 17 15:46:19 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:19 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 Jul 17 15:46:19 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:20 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" returned: 0 in 0.433s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:20 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" returned: 0 in 0.467s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:20 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 1G Jul 17 15:46:20 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:20 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a Jul 17 15:46:20 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:20 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" returned: 0 in 0.284s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-quobyte-b9a13dd6-cd8a-4170-8172-5245c6b71a2a" released by "delete_volume" :: held 0.815s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Created reservations ['08981a24-7064-42f0-9cff-29d3bb084c46', '34790b22-5689-4f26-a7c7-b73b4b2dc47c', 'b07e6e0a-d61e-4f2a-b1ac-76a02ee51cc8', 'f4e83aa0-ee04-4300-80a0-ccc8c6124908'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:20 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:20 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:20 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 1G" returned: 0 in 0.585s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:20 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 Jul 17 15:46:20 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:21 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.444s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Deleted volume successfully. Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (8c473d79-672a-4f83-9bfe-ce918f361ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893ecd73-f166-4260-b979-b26bfaaaabb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595" returned: 0 in 0.495s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:21 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 is being set with open permissions: ugo+rw Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893ecd73-f166-4260-b979-b26bfaaaabb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740798026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b6362a-8b51-4b58-a36e-e6cc73a4b0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:21Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5845e266-9181-4e26-83f4-bc68603802ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5845e266-9181-4e26-83f4-bc68603802ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da39cc17-fd9f-4154-851b-67dc9bf3b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 Jul 17 15:46:21 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da39cc17-fd9f-4154-851b-67dc9bf3b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b6362a-8b51-4b58-a36e-e6cc73a4b0d8', 'volume_name': 'volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879b6934-375b-441d-8834-323e99661cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879b6934-375b-441d-8834-323e99661cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8c7b2c-1eb0-49f5-9f34-574c2e871a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume 87b6362a-8b51-4b58-a36e-e6cc73a4b0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8', 'volume_size': 1} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-81e90cdd-447a-423c-90bc-7a9f3651fd22 tempest-VolumeDependencyTests-291930445 None] Lock "cinder-b9a13dd6-cd8a-4170-8172-5245c6b71a2a-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:21 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (90f8d9a5-68da-44ec-972a-159b7d3a4984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e81bdfb-03cb-41f5-afd2-ad391e227f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595" returned: 0 in 0.492s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e81bdfb-03cb-41f5-afd2-ad391e227f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843580323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1061e5c6-0d4d-4887-bbd3-763898fde1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:22Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d30117e-3b61-460e-b8d9-3a264f6a59cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d30117e-3b61-460e-b8d9-3a264f6a59cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e7a13f-e9fd-4581-bb98-56bcb7f1295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e7a13f-e9fd-4581-bb98-56bcb7f1295c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1061e5c6-0d4d-4887-bbd3-763898fde1c8', 'volume_name': 'volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bea599a-1f80-43a1-b430-b720af8a4e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bea599a-1f80-43a1-b430-b720af8a4e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b548116-e54b-4b78-b870-0350c0066255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:21 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume 1061e5c6-0d4d-4887-bbd3-763898fde1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8', 'volume_size': 1} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:21 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.info Jul 17 15:46:21 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (aa2867f2-caaf-47b7-a7ec-5e7955912fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500825d2-7792-4fa6-894f-d258d31c06c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500825d2-7792-4fa6-894f-d258d31c06c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809722001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8c2348-6cef-4ce0-8259-7832d334b33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:22Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6926d0-e222-475b-9595-c9524c21423a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6926d0-e222-475b-9595-c9524c21423a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a00de7-cd26-4ca9-8b2f-16d8a4525ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a00de7-cd26-4ca9-8b2f-16d8a4525ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb8c2348-6cef-4ce0-8259-7832d334b33b', 'volume_name': 'volume-bb8c2348-6cef-4ce0-8259-7832d334b33b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a95a290-8c16-4a47-b9e6-34dbc0cda070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a95a290-8c16-4a47-b9e6-34dbc0cda070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be2ed41-4fff-4015-a335-6a27bb44e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:22 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume bb8c2348-6cef-4ce0-8259-7832d334b33b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb8c2348-6cef-4ce0-8259-7832d334b33b', 'volume_size': 1} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:22 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.info" returned: 0 in 0.537s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:22 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.info is being set with open permissions: ugo+rw Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:22 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.info Jul 17 15:46:22 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:22 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.info" returned: 0 in 0.326s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.099s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740798026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b6362a-8b51-4b58-a36e-e6cc73a4b0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:21Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Creating volume 87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:22 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:22 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 1073741824 Jul 17 15:46:22 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:22 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:22 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-add69cec-688d-489e-aa15-7bf461af5624 tempest-CinderUnicodeTest-1106331847 None] Create snapshot completed successfully Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (937baa30-bd51-4b9c-97af-94d815a8d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ade14c-f80c-43b9-ba43-e004832fad34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ade14c-f80c-43b9-ba43-e004832fad34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1475923446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00e1532-1932-46eb-b7e9-da7ae4861bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:23Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc923fdd-bc38-4e7f-a397-58256aecfd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc923fdd-bc38-4e7f-a397-58256aecfd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178eadca-734e-4eef-8ee6-1fadd7e8d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178eadca-734e-4eef-8ee6-1fadd7e8d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00e1532-1932-46eb-b7e9-da7ae4861bad', 'volume_name': 'volume-f00e1532-1932-46eb-b7e9-da7ae4861bad', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c0a154-2f76-47b8-a56e-cdd716e3bb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c0a154-2f76-47b8-a56e-cdd716e3bb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2259ea-5b25-4d3e-a5f7-fa5daa5d3c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume f00e1532-1932-46eb-b7e9-da7ae4861bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00e1532-1932-46eb-b7e9-da7ae4861bad', 'volume_size': 1} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:23 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.442s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (2111846e-5e40-4cbc-bc66-186d5e1319a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cde0bf-e6be-4746-82a6-82a5f87a08d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cde0bf-e6be-4746-82a6-82a5f87a08d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-826783195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3dd310d-eae0-4a6e-a3ec-8581e4dd99db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:23Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a9823e-64a0-4a94-8cef-73c2984ca20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a9823e-64a0-4a94-8cef-73c2984ca20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb38129-b1fd-4814-af32-3b3704e09d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb38129-b1fd-4814-af32-3b3704e09d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3dd310d-eae0-4a6e-a3ec-8581e4dd99db', 'volume_name': 'volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1296886-dde3-42ec-8489-4b8289e590dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1296886-dde3-42ec-8489-4b8289e590dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389f8f00-3cba-4472-b50a-808c345184b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume e3dd310d-eae0-4a6e-a3ec-8581e4dd99db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db', 'volume_size': 1} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:23 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 1073741824" returned: 0 in 0.690s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:23 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 Jul 17 15:46:23 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:23 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8" returned: 0 in 0.293s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843580323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1061e5c6-0d4d-4887-bbd3-763898fde1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:22Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Creating volume 1061e5c6-0d4d-4887-bbd3-763898fde1c8 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:23 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8c7b2c-1eb0-49f5-9f34-574c2e871a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 1073741824 Jul 17 15:46:23 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c774ed31-7717-479c-a21b-3d9f423bedc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:23 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 (87b6362a-8b51-4b58-a36e-e6cc73a4b0d8): created successfully Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c774ed31-7717-479c-a21b-3d9f423bedc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (8c473d79-672a-4f83-9bfe-ce918f361ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "cinder-9976828d-f7ff-49d7-9832-2e643bd3f595-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-62ea0f10-d71a-481f-abfb-3c613dc56289 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created volume successfully. Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-9976828d-f7ff-49d7-9832-2e643bd3f595-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "cinder-quobyte-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-quobyte-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "cinder-quobyte-9976828d-f7ff-49d7-9832-2e643bd3f595" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-quobyte-9976828d-f7ff-49d7-9832-2e643bd3f595" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Deleting offline snapshot 9976828d-f7ff-49d7-9832-2e643bd3f595 of volume 6b2e08d3-1e82-4c2e-bb2a-a423290f3160 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] snapshot_file for this snap is: volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b3b387-d011-48a9-918f-ca862f19192c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:24 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 Jul 17 15:46:24 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:24 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 1073741824" returned: 0 in 0.686s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:24 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 Jul 17 15:46:24 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:24 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595" returned: 0 in 0.472s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ec7cd-df64-4595-b41a-5ec6610c8026]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:24 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 Jul 17 15:46:24 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:24 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8" returned: 0 in 0.319s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.725s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809722001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8c2348-6cef-4ce0-8259-7832d334b33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:22Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Creating volume bb8c2348-6cef-4ce0-8259-7832d334b33b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:24 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b548116-e54b-4b78-b870-0350c0066255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc8536d-fc0a-484a-86a2-098f56d3d4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:24 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b 1073741824 Jul 17 15:46:24 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:24 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 (1061e5c6-0d4d-4887-bbd3-763898fde1c8): created successfully Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc8536d-fc0a-484a-86a2-098f56d3d4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:24 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (90f8d9a5-68da-44ec-972a-159b7d3a4984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-adae1631-272c-48a4-bcc2-31752e4472ee tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created volume successfully. Jul 17 15:46:25 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" returned: 0 in 0.457s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:25 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 Jul 17 15:46:25 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9ef7a62c-fa9b-4db4-88f6-50ad978b26f8 tempest-ProjectAdminTests-705161277 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7388076782227, 'free_capacity_gb': 1775.7388076782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87769) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 15:46:25 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b 1073741824" returned: 0 in 0.576s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:25 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595" returned: 0 in 0.400s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:25 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b Jul 17 15:46:25 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:25 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595 Jul 17 15:46:25 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:25 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b" returned: 0 in 0.260s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.632s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1475923446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00e1532-1932-46eb-b7e9-da7ae4861bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:23Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Creating volume f00e1532-1932-46eb-b7e9-da7ae4861bad {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:25 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:25 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160.9976828d-f7ff-49d7-9832-2e643bd3f595" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:25 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad 1073741824 Jul 17 15:46:25 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be2ed41-4fff-4015-a335-6a27bb44e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb8c2348-6cef-4ce0-8259-7832d334b33b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f437530f-d668-4f96-8c64-c3e30e7fb6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:25 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume volume-bb8c2348-6cef-4ce0-8259-7832d334b33b (bb8c2348-6cef-4ce0-8259-7832d334b33b): created successfully Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f437530f-d668-4f96-8c64-c3e30e7fb6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (aa2867f2-caaf-47b7-a7ec-5e7955912fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-quobyte-9976828d-f7ff-49d7-9832-2e643bd3f595" released by "_delete_snapshot" :: held 1.826s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-quobyte-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" released by "delete_snapshot" :: held 1.873s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1695c776-37e7-4558-ac41-9034cfcc9bae tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created volume successfully. Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Created reservations ['2e80ed67-fecb-4d6d-ac7a-51d743d599ac', 'e034530d-39da-4a36-adda-ee29d024f4a8', '0dd73647-f083-4b72-8258-2f260fba2ba0', '00885e03-41f7-41b4-b856-048d3825cd21'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:26 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Delete snapshot completed successfully. Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28cb8175-a01f-4382-876e-7fb10fadeedf tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-9976828d-f7ff-49d7-9832-2e643bd3f595-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:26 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad 1073741824" returned: 0 in 0.577s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:26 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad Jul 17 15:46:26 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:26 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad" returned: 0 in 0.306s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.350s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-826783195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3dd310d-eae0-4a6e-a3ec-8581e4dd99db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c18f494d8c470e8dce40560699d33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:23Z,use_quota=True,user_id='30c34e77f54143008b70fe19702ecbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Creating volume e3dd310d-eae0-4a6e-a3ec-8581e4dd99db {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:26 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:26 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db 1073741824 Jul 17 15:46:26 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2259ea-5b25-4d3e-a5f7-fa5daa5d3c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00e1532-1932-46eb-b7e9-da7ae4861bad', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2335e26-a968-435b-82e6-23dc4eceec27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:26 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume volume-f00e1532-1932-46eb-b7e9-da7ae4861bad (f00e1532-1932-46eb-b7e9-da7ae4861bad): created successfully Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2335e26-a968-435b-82e6-23dc4eceec27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (937baa30-bd51-4b9c-97af-94d815a8d046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:26 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-20ea7fdb-74e1-4a78-83ff-c2813c45802a tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created volume successfully. Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "cinder-6b2e08d3-1e82-4c2e-bb2a-a423290f3160-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-6b2e08d3-1e82-4c2e-bb2a-a423290f3160-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:27 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db 1073741824" returned: 0 in 0.579s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "cinder-quobyte-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-quobyte-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca13b7-0e42-4c46-8316-7fdebad309e2]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:27 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db Jul 17 15:46:27 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:27 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 Jul 17 15:46:27 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:27 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db" returned: 0 in 0.379s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389f8f00-3cba-4472-b50a-808c345184b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3929ab5f-0567-485b-b94a-71347b967145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:27 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Volume volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db (e3dd310d-eae0-4a6e-a3ec-8581e4dd99db): created successfully Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3929ab5f-0567-485b-b94a-71347b967145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Flow 'volume_create_manager' (2111846e-5e40-4cbc-bc66-186d5e1319a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:27 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-99ef801e-8fa8-449e-9597-1fd4165524c2 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created volume successfully. Jul 17 15:46:27 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" returned: 0 in 0.562s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:28 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160 Jul 17 15:46:28 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:28 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" returned: 0 in 0.334s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-quobyte-6b2e08d3-1e82-4c2e-bb2a-a423290f3160" released by "delete_volume" :: held 0.996s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Created reservations ['2e9d8508-383a-475d-9abf-8ae4eb6635cb', 'bdbcb714-68c8-4f7d-8973-f8059730684b', '5ace5d09-b8dc-466a-b718-c5c49ce4067a', 'a7f1d572-9c51-4a0f-960c-062f3b2ae508'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:28 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:28 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:28 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.260s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:28 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Deleted volume successfully. Jul 17 15:46:28 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e5bb26f8-fc2c-4cff-b78f-535c9410d8aa tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-6b2e08d3-1e82-4c2e-bb2a-a423290f3160-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-quobyte-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f950bdf2-f8df-4466-af56-0b2397f3fd37]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:29 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db Jul 17 15:46:29 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "cinder-42a84066-1d98-42bc-b6af-90e6444a2166-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:29 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db" returned: 0 in 0.428s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-42a84066-1d98-42bc-b6af-90e6444a2166-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:29 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db Jul 17 15:46:29 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "cinder-quobyte-42a84066-1d98-42bc-b6af-90e6444a2166" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-quobyte-42a84066-1d98-42bc-b6af-90e6444a2166" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fb0ff7-d84b-4eb7-8e7b-c9ef2be19e00]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:29 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166 Jul 17 15:46:29 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:29 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db" returned: 0 in 0.346s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:29 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db" released by "delete_volume" :: held 0.837s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created reservations ['b53d3664-ac47-4b4b-bcd1-dc8307804734', '50d5c453-df23-4010-827c-1ae8ea84765b', 'db557077-12ea-4954-847e-1ff1f469b5e6', '748c6379-81b4-4857-b581-c3ce4b17d26d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:30 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:30 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:30 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166" returned: 0 in 0.464s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:30 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166 Jul 17 15:46:30 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-f00e1532-1932-46eb-b7e9-da7ae4861bad-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-f00e1532-1932-46eb-b7e9-da7ae4861bad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-quobyte-f00e1532-1932-46eb-b7e9-da7ae4861bad" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:30 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-f00e1532-1932-46eb-b7e9-da7ae4861bad" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.395s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:30 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Deleted volume successfully. Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[befbad45-1e74-40cc-8dac-c276e1336cb9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2768eb08-6c16-492a-a342-4947ae7b9dea tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-e3dd310d-eae0-4a6e-a3ec-8581e4dd99db-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:30 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-42a84066-1d98-42bc-b6af-90e6444a2166" returned: 0 in 0.383s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-quobyte-42a84066-1d98-42bc-b6af-90e6444a2166" released by "delete_volume" :: held 0.908s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Created reservations ['302d3a7b-7fdc-4f92-a365-add2e4e6c446', '89d22bf7-016e-4c5f-90ae-02e896408088', 'fbd3b336-834e-4b20-a342-dbc41ce42d9c', 'ba458a57-05bd-4f22-a678-7bef3510f7da'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:30 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad Jul 17 15:46:30 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:30 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:30 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:31 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad" returned: 0 in 0.587s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:31 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad Jul 17 15:46:31 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:31 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.447s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:31 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Deleted volume successfully. Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-323ac9c6-47cc-47ca-a8e4-38bc7f99b0e4 tempest-CinderUnicodeTest-1106331847 None] Lock "cinder-42a84066-1d98-42bc-b6af-90e6444a2166-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:31 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-f00e1532-1932-46eb-b7e9-da7ae4861bad" returned: 0 in 0.398s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-f00e1532-1932-46eb-b7e9-da7ae4861bad" released by "delete_volume" :: held 1.055s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created reservations ['2e55194d-272b-463f-b906-add425553e19', 'e54f52f7-683a-4271-b0ed-dbf9cf9962e8', 'ea052f83-3551-4b6e-9a15-bba539210377', '62e57ae6-60bd-4bc7-abf8-0820682c6f41'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:31 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:31 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:32 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.323s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:32 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Deleted volume successfully. Jul 17 15:46:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-72751f31-e945-4ac0-80e2-63c6b9743147 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-f00e1532-1932-46eb-b7e9-da7ae4861bad-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-bb8c2348-6cef-4ce0-8259-7832d334b33b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-bb8c2348-6cef-4ce0-8259-7832d334b33b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-quobyte-bb8c2348-6cef-4ce0-8259-7832d334b33b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-bb8c2348-6cef-4ce0-8259-7832d334b33b" acquired by "delete_volume" :: waited 0.030s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:32 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[88199159-4ca0-4501-8a61-704dbb2afe46]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:32 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b Jul 17 15:46:32 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:33 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b" returned: 0 in 0.415s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:33 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b Jul 17 15:46:33 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:33 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-bb8c2348-6cef-4ce0-8259-7832d334b33b" returned: 0 in 0.292s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-bb8c2348-6cef-4ce0-8259-7832d334b33b" released by "delete_volume" :: held 0.789s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created reservations ['e40905cf-c00c-4413-8734-5ef5b361d197', '116cf4e1-2c0b-4df3-97d9-10582636120e', '609212ca-2951-4ccb-9b8b-834097a22a24', '6933434c-f898-4db3-b3ba-1745058d092b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:33 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:33 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-1061e5c6-0d4d-4887-bbd3-763898fde1c8-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-1061e5c6-0d4d-4887-bbd3-763898fde1c8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-quobyte-1061e5c6-0d4d-4887-bbd3-763898fde1c8" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-1061e5c6-0d4d-4887-bbd3-763898fde1c8" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f063e5b-a51b-4391-8436-00699fcdb410]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:34 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.447s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:34 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Deleted volume successfully. Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-aca6847b-7057-4ee9-b6b0-c8b82577d69b tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-bb8c2348-6cef-4ce0-8259-7832d334b33b-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:34 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 Jul 17 15:46:34 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:34 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8" returned: 0 in 0.500s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:34 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8 Jul 17 15:46:34 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:34 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-1061e5c6-0d4d-4887-bbd3-763898fde1c8" returned: 0 in 0.288s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-1061e5c6-0d4d-4887-bbd3-763898fde1c8" released by "delete_volume" :: held 0.861s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created reservations ['6c1a2edc-0632-4dcc-9684-09a24e3ba2f0', '6ffddb45-b735-446d-905d-b2e0fd573f25', '1e17158d-cff9-459f-9917-e9c3d3a9ac20', 'dfc8cc72-2cb6-4992-bce0-a80ef4c12db5'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:35 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:35 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-quobyte-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35960b2-05ed-4961-9184-58f97c2be7ab]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:35 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 Jul 17 15:46:35 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:35 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.427s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:35 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Deleted volume successfully. Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-93bf89d5-ef50-481c-aea1-279a5c08bf65 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-1061e5c6-0d4d-4887-bbd3-763898fde1c8-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:35 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8" returned: 0 in 0.403s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:35 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8 Jul 17 15:46:35 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:36 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8" returned: 0 in 0.294s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8" released by "delete_volume" :: held 0.764s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created reservations ['e30dce58-6903-43b5-93a5-5146cce0c05b', '73cf249c-422a-4b81-8116-ce620ba438eb', '6a763ca4-2612-4c3b-a9be-b14dc5db58bb', 'b32eb2fa-bf68-4f5a-9996-1e87fbd4a2df'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=179,cinder:UPDATE=258,cinder:INSERT=70,cinder:DELETE=23 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:36 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:36 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-0cee16f9-bb68-4d21-8bb2-b319ddcf04f7-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-0cee16f9-bb68-4d21-8bb2-b319ddcf04f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-quobyte-b4505079-d5a2-4f85-833c-4938e63ca9df" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:36 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.313s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-b4505079-d5a2-4f85-833c-4938e63ca9df" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-quobyte-0cee16f9-bb68-4d21-8bb2-b319ddcf04f7" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:36 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Deleted volume successfully. Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-0cee16f9-bb68-4d21-8bb2-b319ddcf04f7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Deleting offline snapshot 0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 of volume b4505079-d5a2-4f85-833c-4938e63ca9df {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] snapshot_file for this snap is: volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-73e82535-6c62-4f01-8d1c-b858749a82b7 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-87b6362a-8b51-4b58-a36e-e6cc73a4b0d8-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bb354d-6941-4a78-af6c-ae2f83a62ffa]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:36 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 Jul 17 15:46:36 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:37 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7" returned: 0 in 0.424s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4505079-d5a2-4f85-833c-4938e63ca9df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:46:37 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa22a5e1-e1b9-4d31-b829-cc7eea679dc9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:37 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df Jul 17 15:46:37 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:37 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df" returned: 0 in 0.422s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:37 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 Jul 17 15:46:37 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:37 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:37 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=264,cinder:SELECT=202,cinder:INSERT=70,cinder:DELETE=24 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:46:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7" returned: 0 in 0.446s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:38 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7 Jul 17 15:46:38 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (122a4f9f-6aa5-482e-b6a6-da13e887a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66290a16-dbfe-4c82-b3d7-c37ca7c2c128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66290a16-dbfe-4c82-b3d7-c37ca7c2c128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253814715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0819180-0b25-4a49-9277-1df8729e6b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:38Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f6444c-2f2d-4b17-8115-61564d1b9406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f6444c-2f2d-4b17-8115-61564d1b9406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49f305b-9d75-4822-8674-b0546102b035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49f305b-9d75-4822-8674-b0546102b035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0819180-0b25-4a49-9277-1df8729e6b40', 'volume_name': 'volume-b0819180-0b25-4a49-9277-1df8729e6b40', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799a4b8d-87e8-4ab1-b5c0-48a0181da07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799a4b8d-87e8-4ab1-b5c0-48a0181da07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc2fc72-6819-4983-b17d-86b3b387693f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:38 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Volume b0819180-0b25-4a49-9277-1df8729e6b40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0819180-0b25-4a49-9277-1df8729e6b40', 'volume_size': 1} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253814715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0819180-0b25-4a49-9277-1df8729e6b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:38Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Creating volume b0819180-0b25-4a49-9277-1df8729e6b40 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:38 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:38 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 1073741824 Jul 17 15:46:38 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:38 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df.0cee16f9-bb68-4d21-8bb2-b319ddcf04f7" returned: 0 in 0.365s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-0cee16f9-bb68-4d21-8bb2-b319ddcf04f7" released by "_delete_snapshot" :: held 1.790s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-b4505079-d5a2-4f85-833c-4938e63ca9df" released by "delete_snapshot" :: held 1.830s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created reservations ['b8dca087-dcf4-4c96-b52a-8d139c67dfb4', 'bf8bff04-0119-4bc0-9c62-e1935e537e5b', '8eae5ea7-c299-422b-81f1-1d279091b887', 'ade7b6d8-a209-46c2-9ca2-17d91ad6a3fe'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:38 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Delete snapshot completed successfully. Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9a9330db-085a-4ab6-b994-12e3c2f65337 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-0cee16f9-bb68-4d21-8bb2-b319ddcf04f7-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:38 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 1073741824" returned: 0 in 0.578s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:38 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 Jul 17 15:46:38 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-b4505079-d5a2-4f85-833c-4938e63ca9df-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-b4505079-d5a2-4f85-833c-4938e63ca9df-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "cinder-quobyte-b4505079-d5a2-4f85-833c-4938e63ca9df" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-b4505079-d5a2-4f85-833c-4938e63ca9df" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:39 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40" returned: 0 in 0.312s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4052c94f-6a82-49e4-8d67-591d93795357]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc2fc72-6819-4983-b17d-86b3b387693f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0819180-0b25-4a49-9277-1df8729e6b40', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93129928-9f6e-4068-bc84-e7931a31ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:39 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Volume volume-b0819180-0b25-4a49-9277-1df8729e6b40 (b0819180-0b25-4a49-9277-1df8729e6b40): created successfully Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93129928-9f6e-4068-bc84-e7931a31ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (122a4f9f-6aa5-482e-b6a6-da13e887a958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:39 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4b0bb12b-77ea-4d31-8f74-4dece31e4bd6 tempest-ProjectReaderTests-1822403046 None] Created volume successfully. Jul 17 15:46:39 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df Jul 17 15:46:39 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:39 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df" returned: 0 in 0.447s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:39 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df Jul 17 15:46:39 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:39 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b4505079-d5a2-4f85-833c-4938e63ca9df" returned: 0 in 0.307s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-quobyte-b4505079-d5a2-4f85-833c-4938e63ca9df" released by "delete_volume" :: held 0.851s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Created reservations ['71ca01d0-ca9b-4f6f-a192-df5ed17a83fe', '222652e3-3ba4-47cf-8b00-94215405e471', '2ea328d8-05a4-4caa-96e8-b7387587465c', '2ccba4be-f80b-47ef-8b9a-bdc4a5495e28'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:40 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:40 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:40 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.339s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:40 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Deleted volume successfully. Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-7a8848e2-8415-4514-a18e-c9067f8fa407 tempest-CreateVolumesFromSnapshotTest-1521896695 None] Lock "cinder-b4505079-d5a2-4f85-833c-4938e63ca9df-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Creating offline snapshot fac4d6a3-c178-484a-acb3-2f008b29ab47 of volume b0819180-0b25-4a49-9277-1df8729e6b40 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f3d05b-aec3-4ab0-b4e2-b8acb8aac634]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:40 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 Jul 17 15:46:40 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:40 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40" returned: 0 in 0.437s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:41 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 1G Jul 17 15:46:41 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:41 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 1G" returned: 0 in 0.559s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0819180-0b25-4a49-9277-1df8729e6b40 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:41 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0819180-0b25-4a49-9277-1df8729e6b40 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 Jul 17 15:46:41 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:41 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0819180-0b25-4a49-9277-1df8729e6b40 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47" returned: 0 in 0.441s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:41 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 is being set with open permissions: ugo+rw Jul 17 15:46:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:42 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 Jul 17 15:46:42 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:42 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47" returned: 0 in 0.294s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:42 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.info Jul 17 15:46:42 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:42 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.info" returned: 0 in 0.292s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:42 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.info is being set with open permissions: ugo+rw Jul 17 15:46:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:42 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.info Jul 17 15:46:42 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:42 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.info" returned: 0 in 0.268s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2c6bbf80-643a-45e7-ae7f-6c5a60de6f66 tempest-ProjectReaderTests-1822403046 None] Create snapshot completed successfully Jul 17 15:46:43 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-fac4d6a3-c178-484a-acb3-2f008b29ab47-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-fac4d6a3-c178-484a-acb3-2f008b29ab47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-b0819180-0b25-4a49-9277-1df8729e6b40" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-b0819180-0b25-4a49-9277-1df8729e6b40" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-fac4d6a3-c178-484a-acb3-2f008b29ab47" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (064b4d62-40da-4683-b52f-e9b727159014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f97dbc-92a7-407d-bbaa-faf4b49c3278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-fac4d6a3-c178-484a-acb3-2f008b29ab47" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Deleting offline snapshot fac4d6a3-c178-484a-acb3-2f008b29ab47 of volume b0819180-0b25-4a49-9277-1df8729e6b40 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] snapshot_file for this snap is: volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f97dbc-92a7-407d-bbaa-faf4b49c3278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902213255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b82a143-936b-4174-96cc-f1d575021f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:44Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196edbb7-335c-4c5b-8757-7cec85fed2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196edbb7-335c-4c5b-8757-7cec85fed2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e577700-bb11-4dd3-8cad-b7af71d5f2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e577700-bb11-4dd3-8cad-b7af71d5f2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b82a143-936b-4174-96cc-f1d575021f9b', 'volume_name': 'volume-2b82a143-936b-4174-96cc-f1d575021f9b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f225a0d4-bf0f-419b-b38a-cc67dfe4dce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f225a0d4-bf0f-419b-b38a-cc67dfe4dce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6cdea8-9c32-422c-b2eb-05d8e69aeffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:44 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Volume 2b82a143-936b-4174-96cc-f1d575021f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b82a143-936b-4174-96cc-f1d575021f9b', 'volume_size': 1} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902213255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b82a143-936b-4174-96cc-f1d575021f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:44Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Creating volume 2b82a143-936b-4174-96cc-f1d575021f9b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:44 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd8e757-abf7-42e5-a81c-e1da1fdacc66]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:44 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b 1073741824 Jul 17 15:46:44 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:44 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 Jul 17 15:46:44 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:44 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47" returned: 0 in 0.415s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0819180-0b25-4a49-9277-1df8729e6b40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54eb336-2e06-4592-a054-d7ff21e8d01d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:44 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b 1073741824" returned: 0 in 0.512s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:44 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b Jul 17 15:46:44 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:44 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 Jul 17 15:46:44 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:45 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40" returned: 0 in 0.445s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:45 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 Jul 17 15:46:45 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:45 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b" returned: 0 in 0.398s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6cdea8-9c32-422c-b2eb-05d8e69aeffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b82a143-936b-4174-96cc-f1d575021f9b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d080ccab-cc1d-4944-ac6a-bbf6339821d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Volume volume-2b82a143-936b-4174-96cc-f1d575021f9b (2b82a143-936b-4174-96cc-f1d575021f9b): created successfully Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d080ccab-cc1d-4944-ac6a-bbf6339821d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (064b4d62-40da-4683-b52f-e9b727159014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2b86d275-ac58-4e9c-8592-14587903b4c6 tempest-ProjectMemberTests-2038443663 None] Created volume successfully. Jul 17 15:46:45 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47" returned: 0 in 0.399s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:45 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47 Jul 17 15:46:45 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Flow 'volume_create_manager' (1adddce7-a57d-49bc-9bf3-61b7001ebdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970b31c8-4f27-4468-a3de-1b7ad02aec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970b31c8-4f27-4468-a3de-1b7ad02aec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490386398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9047b0835d1d4d66bd3db47cadbd2090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:45Z,use_quota=True,user_id='2564dd4b770340449f45848483b358bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f0e414-ddda-48bf-8b56-9744ef9eda5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f0e414-ddda-48bf-8b56-9744ef9eda5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfabbf7-fcaf-4ee1-9c42-32d5bab2a1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfabbf7-fcaf-4ee1-9c42-32d5bab2a1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5', 'volume_name': 'volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4dfc4b-8743-4d3c-ae73-ff1d7af569d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4dfc4b-8743-4d3c-ae73-ff1d7af569d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497d1175-f433-42e9-8638-5db06d3bf106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Volume 7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5', 'volume_size': 1} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490386398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9047b0835d1d4d66bd3db47cadbd2090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:45Z,use_quota=True,user_id='2564dd4b770340449f45848483b358bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Creating volume 7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:45 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:45 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 1073741824 Jul 17 15:46:45 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Flow 'volume_create_manager' (b9b3aabf-fa60-45e6-80af-ce7b36c8b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cb8a4d-eb6a-4989-a0ba-953574dd730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cb8a4d-eb6a-4989-a0ba-953574dd730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24937042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5ad89c-69f6-4124-9244-f3ec2438bdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02210edc89446dafb250be8f8e5526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:46Z,use_quota=True,user_id='86ed3f9867ab4c1dadf3fae08c2c97f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b4f8cf-6b43-4c21-91f7-8a9ad7e323ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b4f8cf-6b43-4c21-91f7-8a9ad7e323ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7cec8a-3131-4128-8a41-c6f3dd2f8299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7cec8a-3131-4128-8a41-c6f3dd2f8299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5ad89c-69f6-4124-9244-f3ec2438bdac', 'volume_name': 'volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cee806-f3fb-4258-83af-9a540d2ec026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cee806-f3fb-4258-83af-9a540d2ec026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3bfdc0-bc61-4d16-aa4b-6d0de17461aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:45 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Volume 5f5ad89c-69f6-4124-9244-f3ec2438bdac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac', 'volume_size': 1} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40.fac4d6a3-c178-484a-acb3-2f008b29ab47" returned: 0 in 0.277s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-fac4d6a3-c178-484a-acb3-2f008b29ab47" released by "_delete_snapshot" :: held 1.733s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-b0819180-0b25-4a49-9277-1df8729e6b40" released by "delete_snapshot" :: held 1.799s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:45 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Created reservations ['780c26fb-826c-4391-9f68-bb2b856dbd79', 'db6a73aa-c033-48fb-9911-40c55da1badb', '751559da-815a-43c1-b187-e96ecd3359aa', '453d257b-ca7f-4f90-9dcd-3feba1e1819a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:46 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Delete snapshot completed successfully. Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c78d6a5a-6853-4ce4-afe6-dda9485a46e3 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-fac4d6a3-c178-484a-acb3-2f008b29ab47-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:46 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 1073741824" returned: 0 in 0.437s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:46 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 Jul 17 15:46:46 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-b0819180-0b25-4a49-9277-1df8729e6b40-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-b0819180-0b25-4a49-9277-1df8729e6b40-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-b0819180-0b25-4a49-9277-1df8729e6b40" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-b0819180-0b25-4a49-9277-1df8729e6b40" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:46 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5" returned: 0 in 0.302s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24937042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5ad89c-69f6-4124-9244-f3ec2438bdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02210edc89446dafb250be8f8e5526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:46Z,use_quota=True,user_id='86ed3f9867ab4c1dadf3fae08c2c97f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Creating volume 5f5ad89c-69f6-4124-9244-f3ec2438bdac {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:46 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[884cc903-ac89-4aad-a333-38189317a2fd]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:46 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac 1073741824 Jul 17 15:46:46 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497d1175-f433-42e9-8638-5db06d3bf106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e294b0-0212-4303-97f5-5a0797c1f27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:46 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Volume volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 (7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5): created successfully Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e294b0-0212-4303-97f5-5a0797c1f27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Flow 'volume_create_manager' (1adddce7-a57d-49bc-9bf3-61b7001ebdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:46 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-760998c5-36a2-4683-b266-695b838bdbff tempest-ProjectReaderTests-887814379 None] Created volume successfully. Jul 17 15:46:46 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 Jul 17 15:46:46 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:46 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40" returned: 0 in 0.427s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:46 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:46 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40 Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac 1073741824" returned: 0 in 0.483s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:47 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:47 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac Jul 17 15:46:47 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:47 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b0819180-0b25-4a49-9277-1df8729e6b40" returned: 0 in 0.263s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-b0819180-0b25-4a49-9277-1df8729e6b40" released by "delete_volume" :: held 0.800s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Created reservations ['aaade10f-6efe-45db-b711-d85c45a76edc', '8dcb1cdb-e1cc-49f9-97fb-9d5aae5bdf21', '29066b13-3761-420d-8b9e-a44b8204573f', '44c85509-cf39-4afb-adbe-bd6a3ea675ef'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:47 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac" returned: 0 in 0.266s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.553s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Creating offline snapshot 555de337-feb5-4044-b6ec-32a26d31263b of volume 2b82a143-936b-4174-96cc-f1d575021f9b {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3bfdc0-bc61-4d16-aa4b-6d0de17461aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd985c8-4dcb-463b-8ebd-c9caee58cc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b046fae-0ce1-4c59-b357-8b421e3c423c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:47 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Volume volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac (5f5ad89c-69f6-4124-9244-f3ec2438bdac): created successfully Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd985c8-4dcb-463b-8ebd-c9caee58cc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Flow 'volume_create_manager' (b9b3aabf-fa60-45e6-80af-ce7b36c8b898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:47 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-56ae1b08-3642-440e-822e-0a5b8d9f5c68 tempest-ProjectReaderTests-2034714694 None] Created volume successfully. Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:47 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:47 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:47 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b Jul 17 15:46:47 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:47 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:47 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Deleted volume successfully. Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1b2cf151-12a9-4a4f-aded-12f8a6f56218 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-b0819180-0b25-4a49-9277-1df8729e6b40-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:47 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b" returned: 0 in 0.438s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:47 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b 1G Jul 17 15:46:47 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "cinder-5f5ad89c-69f6-4124-9244-f3ec2438bdac-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Lock "cinder-5f5ad89c-69f6-4124-9244-f3ec2438bdac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "cinder-quobyte-5f5ad89c-69f6-4124-9244-f3ec2438bdac" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Lock "cinder-quobyte-5f5ad89c-69f6-4124-9244-f3ec2438bdac" acquired by "delete_volume" :: waited 0.025s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Acquiring lock "cinder-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5327517e-b3f5-4076-b509-a18e693eaa73]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Lock "cinder-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Acquiring lock "cinder-quobyte-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Lock "cinder-quobyte-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5" acquired by "delete_volume" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db30bb2-a7a5-4c53-b5ce-8d27f60b67f8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:48 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac Jul 17 15:46:48 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:48 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 Jul 17 15:46:48 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:48 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b 1G" returned: 0 in 0.564s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b82a143-936b-4174-96cc-f1d575021f9b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:48 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b82a143-936b-4174-96cc-f1d575021f9b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b Jul 17 15:46:48 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (310fac86-9bfe-4648-878e-bd702d1fad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59430b8-3029-4bf1-94ec-8ac94e92cef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59430b8-3029-4bf1-94ec-8ac94e92cef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366572148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c032c5b1-0935-4fb5-996a-71bfb1d90a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:48Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5185709-387f-4c70-874d-4342b08ac6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5185709-387f-4c70-874d-4342b08ac6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cd863d-634a-4d22-a511-e03ffd1b86af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cd863d-634a-4d22-a511-e03ffd1b86af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c032c5b1-0935-4fb5-996a-71bfb1d90a1a', 'volume_name': 'volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac04e87-6b06-4906-9397-32c95e9a78ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:48 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac04e87-6b06-4906-9397-32c95e9a78ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d5477e-a7cc-49f4-b727-72991f552063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:48 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Volume c032c5b1-0935-4fb5-996a-71bfb1d90a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a', 'volume_size': 1} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac" returned: 0 in 0.508s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:48 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac Jul 17 15:46:48 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:48 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5" returned: 0 in 0.481s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:48 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5 Jul 17 15:46:48 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:48 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b82a143-936b-4174-96cc-f1d575021f9b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b" returned: 0 in 0.331s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:48 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b is being set with open permissions: ugo+rw Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:48 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b Jul 17 15:46:48 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:48 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-5f5ad89c-69f6-4124-9244-f3ec2438bdac" returned: 0 in 0.297s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Lock "cinder-quobyte-5f5ad89c-69f6-4124-9244-f3ec2438bdac" released by "delete_volume" :: held 0.869s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:48 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5" returned: 0 in 0.291s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Created reservations ['7454c575-728f-475f-80a1-d98d02e8186a', '788d3dca-69d6-48f7-a034-2f9b952a03c1', 'b5f714cc-8965-4c9a-a02e-deae410d2b10', '77772444-304e-4fdc-b7ac-04eea7c005d9'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Lock "cinder-quobyte-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5" released by "delete_volume" :: held 0.844s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:49 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b" returned: 0 in 0.314s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Created reservations ['66629fa6-29f0-47cf-9b40-0805d976c032', '7e53640c-6be6-4bef-8fab-e62eb4e763b3', '1cf60ec5-56dc-42c8-9100-9cf9bc0a8324', 'dbf70241-894a-4f81-8807-665c19cbcff0'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:49 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.info Jul 17 15:46:49 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:49 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:49 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:49 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:49 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:49 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.info" returned: 0 in 0.362s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:49 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.info is being set with open permissions: ugo+rw Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:49 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.info Jul 17 15:46:49 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:49 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.503s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:49 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Deleted volume successfully. Jul 17 15:46:49 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-38ac7ce6-b368-4095-9a7a-5b59601bd707 tempest-ProjectReaderTests-2034714694 None] Lock "cinder-5f5ad89c-69f6-4124-9244-f3ec2438bdac-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.439s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:49 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Deleted volume successfully. Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-fdbe4fca-b75d-4bb6-a2c6-617cbf86efc3 tempest-ProjectReaderTests-887814379 None] Lock "cinder-7b0b9afc-bf93-4247-b40e-9e7c80fb3bc5-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:49 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.info" returned: 0 in 0.360s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366572148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c032c5b1-0935-4fb5-996a-71bfb1d90a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:48Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Creating volume c032c5b1-0935-4fb5-996a-71bfb1d90a1a {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:49 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:49 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a 1073741824 Jul 17 15:46:49 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:49 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-30e174ee-82be-4034-bb74-da807f0d7ed7 tempest-ProjectMemberTests-2038443663 None] Create snapshot completed successfully Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Flow 'volume_create_manager' (60994ff2-83c3-4c9b-99d3-e5640dbf056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285fc0f4-2606-423c-8af0-db36c12257e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285fc0f4-2606-423c-8af0-db36c12257e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645260914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc69947-d367-4ab3-9cae-cd8557fe6a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02210edc89446dafb250be8f8e5526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:50Z,use_quota=True,user_id='86ed3f9867ab4c1dadf3fae08c2c97f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd138dd-8270-426b-a42e-78491a721488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd138dd-8270-426b-a42e-78491a721488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c528e711-0cea-4c66-8e10-bbdd6cfaea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c528e711-0cea-4c66-8e10-bbdd6cfaea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc69947-d367-4ab3-9cae-cd8557fe6a1b', 'volume_name': 'volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060134c3-2b2c-494b-8861-f8be8e3143ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060134c3-2b2c-494b-8861-f8be8e3143ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1bd7d93-9767-4e05-ae06-b62c1f188600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Volume dbc69947-d367-4ab3-9cae-cd8557fe6a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b', 'volume_size': 1} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-555de337-feb5-4044-b6ec-32a26d31263b-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-555de337-feb5-4044-b6ec-32a26d31263b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-2b82a143-936b-4174-96cc-f1d575021f9b" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Flow 'volume_create_manager' (a6e830e8-a8fc-44e8-ac22-25a9f9ec3150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8b1347-df6a-407e-b7a3-edfe3abdf202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-2b82a143-936b-4174-96cc-f1d575021f9b" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-555de337-feb5-4044-b6ec-32a26d31263b" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8b1347-df6a-407e-b7a3-edfe3abdf202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-857203201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2762c7d3-ec34-4fb2-8053-21cdd4cab4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9047b0835d1d4d66bd3db47cadbd2090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:50Z,use_quota=True,user_id='2564dd4b770340449f45848483b358bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd49f083-47dd-4535-a33a-d776179e3a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd49f083-47dd-4535-a33a-d776179e3a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1be0939-19be-42d7-a051-e7f3cb057c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1be0939-19be-42d7-a051-e7f3cb057c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2762c7d3-ec34-4fb2-8053-21cdd4cab4da', 'volume_name': 'volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f06afb-e083-4018-b6d7-9094752962ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f06afb-e083-4018-b6d7-9094752962ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c7e8f9-53f3-439e-9a09-40aa3f78481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Volume 2762c7d3-ec34-4fb2-8053-21cdd4cab4da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da', 'volume_size': 1} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-555de337-feb5-4044-b6ec-32a26d31263b" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Deleting offline snapshot 555de337-feb5-4044-b6ec-32a26d31263b of volume 2b82a143-936b-4174-96cc-f1d575021f9b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] snapshot_file for this snap is: volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a093a1-3a97-49fb-8a6a-cfbd2cccaf51]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:50 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a 1073741824" returned: 0 in 0.481s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:50 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a Jul 17 15:46:50 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:50 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b Jul 17 15:46:50 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:50 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" returned: 0 in 0.264s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645260914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc69947-d367-4ab3-9cae-cd8557fe6a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02210edc89446dafb250be8f8e5526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:50Z,use_quota=True,user_id='86ed3f9867ab4c1dadf3fae08c2c97f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Creating volume dbc69947-d367-4ab3-9cae-cd8557fe6a1b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:50 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:50 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d5477e-a7cc-49f4-b727-72991f552063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b 1073741824 Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3196741-6fd9-4eeb-8726-d30b9d061846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:50 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b" returned: 0 in 0.399s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b82a143-936b-4174-96cc-f1d575021f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:46:50 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Volume volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a (c032c5b1-0935-4fb5-996a-71bfb1d90a1a): created successfully Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3196741-6fd9-4eeb-8726-d30b9d061846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (310fac86-9bfe-4648-878e-bd702d1fad6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27ea7c1-5b70-4f5a-8c6b-fece9bf62160]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:50 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-70c32880-51f0-4fa0-9ffc-eeb4f9ebf0b5 tempest-ProjectReaderTests-1822403046 None] Created volume successfully. Jul 17 15:46:50 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b Jul 17 15:46:50 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:51 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b 1073741824" returned: 0 in 0.446s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:51 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b Jul 17 15:46:51 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:51 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b" returned: 0 in 0.445s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:51 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b Jul 17 15:46:51 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:51 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b" returned: 0 in 0.246s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-857203201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2762c7d3-ec34-4fb2-8053-21cdd4cab4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9047b0835d1d4d66bd3db47cadbd2090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:50Z,use_quota=True,user_id='2564dd4b770340449f45848483b358bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Creating volume 2762c7d3-ec34-4fb2-8053-21cdd4cab4da {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:51 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1bd7d93-9767-4e05-ae06-b62c1f188600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:51 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da 1073741824 Jul 17 15:46:51 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb551d76-8a29-4341-be95-4cfa7ad7a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:51 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Volume volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b (dbc69947-d367-4ab3-9cae-cd8557fe6a1b): created successfully Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb551d76-8a29-4341-be95-4cfa7ad7a36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Flow 'volume_create_manager' (60994ff2-83c3-4c9b-99d3-e5640dbf056c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:51 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c2f92bd6-93a1-45c4-8511-e42723474681 tempest-ProjectReaderTests-2034714694 None] Created volume successfully. Jul 17 15:46:51 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b" returned: 0 in 0.361s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:51 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b Jul 17 15:46:51 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:51 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b.555de337-feb5-4044-b6ec-32a26d31263b" returned: 0 in 0.275s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-555de337-feb5-4044-b6ec-32a26d31263b" released by "_delete_snapshot" :: held 1.647s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Acquiring lock "cinder-dbc69947-d367-4ab3-9cae-cd8557fe6a1b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-2b82a143-936b-4174-96cc-f1d575021f9b" released by "delete_snapshot" :: held 1.720s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:51 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da 1073741824" returned: 0 in 0.568s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:51 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Lock "cinder-dbc69947-d367-4ab3-9cae-cd8557fe6a1b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Acquiring lock "cinder-quobyte-dbc69947-d367-4ab3-9cae-cd8557fe6a1b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Lock "cinder-quobyte-dbc69947-d367-4ab3-9cae-cd8557fe6a1b" acquired by "delete_volume" :: waited 0.035s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:52 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da Jul 17 15:46:52 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Created reservations ['677b66db-0747-469e-8862-6b1cc969c478', '79050934-6a18-41d8-920d-e626556be2ae', 'b7d62f13-3485-496f-8c37-16d4923ecc1e', 'a227d6ba-81e8-4eb8-9076-60241adb1f54'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e72043-3790-404b-874b-018a55e2f008]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Delete snapshot completed successfully. Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-c939e52b-6c0e-4528-9253-a4ee8306d532 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-555de337-feb5-4044-b6ec-32a26d31263b-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:52 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b Jul 17 15:46:52 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-2b82a143-936b-4174-96cc-f1d575021f9b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-2b82a143-936b-4174-96cc-f1d575021f9b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:52 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-2b82a143-936b-4174-96cc-f1d575021f9b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da" returned: 0 in 0.305s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-2b82a143-936b-4174-96cc-f1d575021f9b" acquired by "delete_volume" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.410s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c7e8f9-53f3-439e-9a09-40aa3f78481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353a406a-4ca7-4370-93f0-c3da8e59ffd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c48c2ee-ed9c-457b-b119-c532f39838a6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Creating offline snapshot 495dbf4e-3adf-4370-a21b-1696c359b695 of volume c032c5b1-0935-4fb5-996a-71bfb1d90a1a {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:46:52 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Volume volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da (2762c7d3-ec34-4fb2-8053-21cdd4cab4da): created successfully Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353a406a-4ca7-4370-93f0-c3da8e59ffd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Flow 'volume_create_manager' (a6e830e8-a8fc-44e8-ac22-25a9f9ec3150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c41142a-bbaf-4fbe-9f96-c7f4d2698154]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e31a4366-8548-4e4e-bfbc-25ae8bf0e7c2 tempest-ProjectReaderTests-887814379 None] Created volume successfully. Jul 17 15:46:52 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b" returned: 0 in 0.398s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:52 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b Jul 17 15:46:52 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:52 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b Jul 17 15:46:52 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:52 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a Jul 17 15:46:52 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:52 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-dbc69947-d367-4ab3-9cae-cd8557fe6a1b" returned: 0 in 0.259s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Lock "cinder-quobyte-dbc69947-d367-4ab3-9cae-cd8557fe6a1b" released by "delete_volume" :: held 0.715s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:52 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b" returned: 0 in 0.403s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:52 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b Jul 17 15:46:52 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:52 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" returned: 0 in 0.400s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Created reservations ['9ff7e3cd-0ab1-40de-8161-c42ae3417b43', 'c07f996e-cd37-468d-bc7d-051bf864d626', '36e85103-5dbb-4552-ae24-bed47f8e7933', '5b6bc2f3-0f6f-4c13-bbee-426e0e1f357d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:52 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 1G Jul 17 15:46:52 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:52 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:52 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:53 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2b82a143-936b-4174-96cc-f1d575021f9b" returned: 0 in 0.273s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-2b82a143-936b-4174-96cc-f1d575021f9b" released by "delete_volume" :: held 0.754s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Created reservations ['99aedd2a-c7d2-4dc2-8eda-d9dd836b2537', 'ee961b61-8e69-42df-a0bb-44c2636f77f1', '8823e4af-3ee7-4343-93ed-d6835ac8a7a0', 'd465e32c-13ba-4072-a00a-09219efc9474'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:53 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:53 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:53 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.363s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Deleted volume successfully. Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Acquiring lock "cinder-2762c7d3-ec34-4fb2-8053-21cdd4cab4da-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5a10aca8-786e-4c7d-8245-f60233f8a35c tempest-ProjectReaderTests-2034714694 None] Lock "cinder-dbc69947-d367-4ab3-9cae-cd8557fe6a1b-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Lock "cinder-2762c7d3-ec34-4fb2-8053-21cdd4cab4da-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Acquiring lock "cinder-quobyte-2762c7d3-ec34-4fb2-8053-21cdd4cab4da" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:53 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 1G" returned: 0 in 0.618s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Lock "cinder-quobyte-2762c7d3-ec34-4fb2-8053-21cdd4cab4da" acquired by "delete_volume" :: waited 0.041s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:53 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 Jul 17 15:46:53 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[898c58f2-0d1b-4c06-b128-b98eab3d557a]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:53 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.333s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:53 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Deleted volume successfully. Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-99d0b154-c72b-4cfa-9c1c-f2b80c4125f2 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-2b82a143-936b-4174-96cc-f1d575021f9b-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:53 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da Jul 17 15:46:53 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:53 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695" returned: 0 in 0.434s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:53 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 is being set with open permissions: ugo+rw Jul 17 15:46:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:53 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 Jul 17 15:46:53 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Flow 'volume_create_manager' (57481b63-f9fb-47c4-8f8c-b31224cd6230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d1aa37-cb58-48b9-b54b-0a049b547a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d1aa37-cb58-48b9-b54b-0a049b547a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448141825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02210edc89446dafb250be8f8e5526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:54Z,use_quota=True,user_id='86ed3f9867ab4c1dadf3fae08c2c97f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe40ac1-2d07-4605-911a-291209bed27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe40ac1-2d07-4605-911a-291209bed27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecd2706-c291-4d33-af6d-a569dbd81e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecd2706-c291-4d33-af6d-a569dbd81e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a', 'volume_name': 'volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7b0447-8b00-4ebd-8c05-1665fe63010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7b0447-8b00-4ebd-8c05-1665fe63010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7a9c4a-017c-4bc6-98c1-083aaec2638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Volume 7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a', 'volume_size': 1} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:54 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da" returned: 0 in 0.702s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:54 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da Jul 17 15:46:54 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:54 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695" returned: 0 in 0.397s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (c1239413-267c-4780-a410-637f0bc6a811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee013b40-1a4a-4c1a-9e80-7e41811088e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee013b40-1a4a-4c1a-9e80-7e41811088e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1407893345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c1c4d2-c197-4f94-8172-9de78fb32400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:54Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:54 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.info Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c370a8-c914-43d3-9e8d-b92e19308bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c370a8-c914-43d3-9e8d-b92e19308bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a738bca-a639-4d6d-bd11-febc70ca9824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a738bca-a639-4d6d-bd11-febc70ca9824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c1c4d2-c197-4f94-8172-9de78fb32400', 'volume_name': 'volume-62c1c4d2-c197-4f94-8172-9de78fb32400', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df772a7-3fed-4cca-8c9f-19f09baad162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df772a7-3fed-4cca-8c9f-19f09baad162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93caabe2-7983-4e33-b6bb-178ddab3ddcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:54 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Volume 62c1c4d2-c197-4f94-8172-9de78fb32400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c1c4d2-c197-4f94-8172-9de78fb32400', 'volume_size': 1} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:54 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-2762c7d3-ec34-4fb2-8053-21cdd4cab4da" returned: 0 in 0.286s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Lock "cinder-quobyte-2762c7d3-ec34-4fb2-8053-21cdd4cab4da" released by "delete_volume" :: held 1.049s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Created reservations ['9d9dc5a8-2ca8-4be3-9abb-408bb5c705aa', '5f75acd2-df44-432a-bc81-9050a4ac9b2d', '2c961d8b-48e9-4dc7-aeda-9956aa07d614', '7553705a-4ed2-4d97-a79a-bfa8c1f03834'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:54 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.info" returned: 0 in 0.270s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:54 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.info is being set with open permissions: ugo+rw Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:54 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.info Jul 17 15:46:54 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:54 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:54 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:54 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.info" returned: 0 in 0.256s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448141825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02210edc89446dafb250be8f8e5526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:54Z,use_quota=True,user_id='86ed3f9867ab4c1dadf3fae08c2c97f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Creating volume 7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:54 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:54 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.271s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:54 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a 1073741824 Jul 17 15:46:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Deleted volume successfully. Jul 17 15:46:54 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b1dbcd6a-6cc6-49b1-bd70-232721a00d60 tempest-ProjectReaderTests-1822403046 None] Create snapshot completed successfully Jul 17 15:46:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-439b2233-fc7f-441d-ad8f-447f2536f2da tempest-ProjectReaderTests-887814379 None] Lock "cinder-2762c7d3-ec34-4fb2-8053-21cdd4cab4da-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-495dbf4e-3adf-4370-a21b-1696c359b695-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Lock "cinder-495dbf4e-3adf-4370-a21b-1696c359b695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-495dbf4e-3adf-4370-a21b-1696c359b695" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-495dbf4e-3adf-4370-a21b-1696c359b695" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Deleting offline snapshot 495dbf4e-3adf-4370-a21b-1696c359b695 of volume c032c5b1-0935-4fb5-996a-71bfb1d90a1a {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] snapshot_file for this snap is: volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbb35c6-bce5-4de9-9009-dedbafbee699]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:55 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 Jul 17 15:46:55 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:55 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a 1073741824" returned: 0 in 0.450s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:55 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a Jul 17 15:46:55 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:55 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695" returned: 0 in 0.382s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fae9e7-4353-48db-93f2-bd0a646196e6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:55 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a" returned: 0 in 0.260s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1407893345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c1c4d2-c197-4f94-8172-9de78fb32400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:54Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Creating volume 62c1c4d2-c197-4f94-8172-9de78fb32400 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:55 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:55 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 1073741824 Jul 17 15:46:55 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7a9c4a-017c-4bc6-98c1-083aaec2638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8cda7d-2df4-45ac-a027-e4b99f01ad23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:55 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Volume volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a (7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a): created successfully Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8cda7d-2df4-45ac-a027-e4b99f01ad23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:55 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Flow 'volume_create_manager' (57481b63-f9fb-47c4-8f8c-b31224cd6230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-77a9b13c-7ee3-405f-bd12-d3c37070409a tempest-ProjectReaderTests-2034714694 None] Created volume successfully. Jul 17 15:46:55 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a Jul 17 15:46:55 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "cinder-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Lock "cinder-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:56 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" returned: 0 in 0.464s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "cinder-quobyte-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:56 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 Jul 17 15:46:56 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Lock "cinder-quobyte-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a" acquired by "delete_volume" :: waited 0.027s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[846b4fb7-c59b-4c67-b034-9734077c67e6]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:56 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 1073741824" returned: 0 in 0.633s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:56 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a Jul 17 15:46:56 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:56 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 Jul 17 15:46:56 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:56 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695" returned: 0 in 0.411s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:56 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695 Jul 17 15:46:56 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:56 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400" returned: 0 in 0.274s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:56 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a" returned: 0 in 0.448s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:56 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a Jul 17 15:46:56 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93caabe2-7983-4e33-b6bb-178ddab3ddcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c1c4d2-c197-4f94-8172-9de78fb32400', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3db947-7596-42f6-b6eb-dd963380b857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:56 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Volume volume-62c1c4d2-c197-4f94-8172-9de78fb32400 (62c1c4d2-c197-4f94-8172-9de78fb32400): created successfully Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3db947-7596-42f6-b6eb-dd963380b857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (c1239413-267c-4780-a410-637f0bc6a811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:56 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-80b1556e-003d-448a-8c80-d5a440ac85a9 tempest-ProjectMemberTests-2038443663 None] Created volume successfully. Jul 17 15:46:56 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a.495dbf4e-3adf-4370-a21b-1696c359b695" returned: 0 in 0.328s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-495dbf4e-3adf-4370-a21b-1696c359b695" released by "_delete_snapshot" :: held 1.703s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" released by "delete_snapshot" :: held 1.730s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:56 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a" returned: 0 in 0.302s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Lock "cinder-quobyte-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a" released by "delete_volume" :: held 0.802s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:56 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Created reservations ['addb519b-a52d-459e-90ab-efbc8832b995', '6e976e3f-fd80-4d59-81b8-dae2b72fb270', '268f7526-8eed-40e2-ac52-757046096200', '1352cb4a-0353-40dd-b1a5-499cb6a0edf8'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Created reservations ['c4e3d156-b535-4512-80ef-159979934029', '7a4058ee-9cac-485f-9758-e171d39f6cd4', 'b2cc2eac-f4a3-415b-91d5-a6695e053a83', '0d275ecf-e136-4528-b7d6-62d4136fe48e'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:57 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Delete snapshot completed successfully. Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-bcc4b861-3b55-4c7c-bba8-30c446d1d2cb tempest-ProjectReaderTests-1822403046 None] Lock "cinder-495dbf4e-3adf-4370-a21b-1696c359b695-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:57 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:57 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:57 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.352s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:57 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Deleted volume successfully. Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-4f19b1c2-9700-4dd5-bff1-2904788079a8 tempest-ProjectReaderTests-2034714694 None] Lock "cinder-7b75e07b-24e0-4fc1-aa1a-1a90e660ce0a-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-c032c5b1-0935-4fb5-996a-71bfb1d90a1a-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Creating offline snapshot 0332ce85-35f4-4439-9f08-7f8b9ae617a4 of volume 62c1c4d2-c197-4f94-8172-9de78fb32400 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Lock "cinder-c032c5b1-0935-4fb5-996a-71bfb1d90a1a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b26df55-c88a-4b5d-a327-f359ec07a680]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9684630-a46e-4009-aaba-840408ddcd63]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:57 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 Jul 17 15:46:57 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Flow 'volume_create_manager' (c450aa18-5f72-4c97-b5af-4a12fe5b53ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18ec830-9e94-4e16-b0dd-34db0ac8cd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18ec830-9e94-4e16-b0dd-34db0ac8cd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788297520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5497e76-a1f2-4c21-97a7-c438661fd3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02210edc89446dafb250be8f8e5526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:58Z,use_quota=True,user_id='86ed3f9867ab4c1dadf3fae08c2c97f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:57 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a Jul 17 15:46:57 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29778618-8008-45c8-b6b1-03e09f21d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29778618-8008-45c8-b6b1-03e09f21d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574a5740-ffc7-4377-8ad3-26e838b3566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574a5740-ffc7-4377-8ad3-26e838b3566e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5497e76-a1f2-4c21-97a7-c438661fd3f4', 'volume_name': 'volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a416203-f940-49b4-9b13-b8e41ddf0bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a416203-f940-49b4-9b13-b8e41ddf0bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308429b1-ef0b-4f39-acd9-9772fb55bcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:57 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Volume d5497e76-a1f2-4c21-97a7-c438661fd3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4', 'volume_size': 1} Jul 17 15:46:57 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:58 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400" returned: 0 in 0.450s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:58 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 1G Jul 17 15:46:58 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:58 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" returned: 0 in 0.407s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:58 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a Jul 17 15:46:58 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:58 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" returned: 0 in 0.254s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-c032c5b1-0935-4fb5-996a-71bfb1d90a1a" released by "delete_volume" :: held 0.746s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:58 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 1G" returned: 0 in 0.391s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c1c4d2-c197-4f94-8172-9de78fb32400 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:58 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c1c4d2-c197-4f94-8172-9de78fb32400 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 Jul 17 15:46:58 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Created reservations ['79208f7d-1009-4ab6-994d-0c76b75d484b', 'ee04e93f-bf8e-4a6e-ad1c-935c8a8769c2', 'f2c1af46-f36d-486a-929a-833955273826', 'dd62c6b6-eaa5-4d88-9445-af811ad3792e'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:58 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:46:58 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:58 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c1c4d2-c197-4f94-8172-9de78fb32400 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4" returned: 0 in 0.336s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:58 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 is being set with open permissions: ugo+rw Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:58 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.263s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:46:58 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 Jul 17 15:46:58 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Deleted volume successfully. Jul 17 15:46:58 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:58 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8b852dd5-3274-438d-b937-9b9ddc3359ac tempest-ProjectReaderTests-1822403046 None] Lock "cinder-c032c5b1-0935-4fb5-996a-71bfb1d90a1a-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:46:59 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4" returned: 0 in 0.263s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:59 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.info Jul 17 15:46:59 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (cdaa5975-43be-4538-8e18-ca4a814442a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270a8e14-b31c-4117-9dd4-215a27fdde35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270a8e14-b31c-4117-9dd4-215a27fdde35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189124850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cbd0bd-9878-4896-9db5-8b1a71ea5bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:59Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:59 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed890a6b-6be3-46c6-bb9c-8a4a48fc1010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed890a6b-6be3-46c6-bb9c-8a4a48fc1010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e021646b-a8d0-4bed-8e56-11196331f67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e021646b-a8d0-4bed-8e56-11196331f67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49cbd0bd-9878-4896-9db5-8b1a71ea5bc1', 'volume_name': 'volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c188e2-a694-43db-aa07-24a5d90a2e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c188e2-a694-43db-aa07-24a5d90a2e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4ad022-0b61-418e-a623-2ad20c883751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:46:59 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Volume 49cbd0bd-9878-4896-9db5-8b1a71ea5bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1', 'volume_size': 1} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.info" returned: 0 in 0.292s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:59 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.info is being set with open permissions: ugo+rw Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:59 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.info Jul 17 15:46:59 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:59 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.info" returned: 0 in 0.236s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788297520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5497e76-a1f2-4c21-97a7-c438661fd3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02210edc89446dafb250be8f8e5526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:58Z,use_quota=True,user_id='86ed3f9867ab4c1dadf3fae08c2c97f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Creating volume d5497e76-a1f2-4c21-97a7-c438661fd3f4 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:46:59 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:46:59 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:46:59 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 1073741824 Jul 17 15:46:59 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:46:59 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-25954570-777e-47a6-8dcc-91f84491ca63 tempest-ProjectMemberTests-2038443663 None] Create snapshot completed successfully Jul 17 15:47:00 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 1073741824" returned: 0 in 0.441s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:00 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 Jul 17 15:47:00 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:00 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4" returned: 0 in 0.244s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189124850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cbd0bd-9878-4896-9db5-8b1a71ea5bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:46:59Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Creating volume 49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:00 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308429b1-ef0b-4f39-acd9-9772fb55bcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:00 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 1073741824 Jul 17 15:47:00 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b08fc6-f936-40c3-aeec-6dc577db3cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:00 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Volume volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 (d5497e76-a1f2-4c21-97a7-c438661fd3f4): created successfully Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b08fc6-f936-40c3-aeec-6dc577db3cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Flow 'volume_create_manager' (c450aa18-5f72-4c97-b5af-4a12fe5b53ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:00 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b54047c5-2375-4d21-8136-47aa10465237 tempest-ProjectReaderTests-2034714694 None] Created volume successfully. Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-0332ce85-35f4-4439-9f08-7f8b9ae617a4-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Lock "cinder-0332ce85-35f4-4439-9f08-7f8b9ae617a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-62c1c4d2-c197-4f94-8172-9de78fb32400" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-62c1c4d2-c197-4f94-8172-9de78fb32400" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-0332ce85-35f4-4439-9f08-7f8b9ae617a4" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-0332ce85-35f4-4439-9f08-7f8b9ae617a4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Deleting offline snapshot 0332ce85-35f4-4439-9f08-7f8b9ae617a4 of volume 62c1c4d2-c197-4f94-8172-9de78fb32400 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:00 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] snapshot_file for this snap is: volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 1073741824" returned: 0 in 0.448s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbdb871-9b5d-499b-a6dc-24380ff0b92c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:00 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:00 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 Jul 17 15:47:00 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:01 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 Jul 17 15:47:01 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Acquiring lock "cinder-d5497e76-a1f2-4c21-97a7-c438661fd3f4-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Lock "cinder-d5497e76-a1f2-4c21-97a7-c438661fd3f4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Acquiring lock "cinder-quobyte-d5497e76-a1f2-4c21-97a7-c438661fd3f4" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Lock "cinder-quobyte-d5497e76-a1f2-4c21-97a7-c438661fd3f4" acquired by "delete_volume" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9ba786-9924-43e0-9be3-f23ff46fe23b]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:01 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" returned: 0 in 0.289s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4ad022-0b61-418e-a623-2ad20c883751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbddc71e-4448-4a63-bf8d-fcdb587f766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:01 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Volume volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 (49cbd0bd-9878-4896-9db5-8b1a71ea5bc1): created successfully Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbddc71e-4448-4a63-bf8d-fcdb587f766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (cdaa5975-43be-4538-8e18-ca4a814442a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:01 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-26912367-3e9e-4d6a-a52a-64eee061befb tempest-ProjectReaderTests-1822403046 None] Created volume successfully. Jul 17 15:47:01 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 Jul 17 15:47:01 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:01 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4" returned: 0 in 0.437s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62c1c4d2-c197-4f94-8172-9de78fb32400(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[525d98dc-de8d-4c03-a87a-d71c78c6cbe9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:01 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 Jul 17 15:47:01 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Creating offline snapshot c79605a6-134a-4fc1-8e68-26affb540426 of volume 49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:01 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4" returned: 0 in 0.429s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f071e3-cd42-43fa-8578-b610fe6c6440]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:01 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4 Jul 17 15:47:01 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:01 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 Jul 17 15:47:01 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:01 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400" returned: 0 in 0.396s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:01 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 Jul 17 15:47:01 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:01 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d5497e76-a1f2-4c21-97a7-c438661fd3f4" returned: 0 in 0.289s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:01 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Lock "cinder-quobyte-d5497e76-a1f2-4c21-97a7-c438661fd3f4" released by "delete_volume" :: held 0.761s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Created reservations ['a75cf0d9-871f-49d9-9362-d8b72867d59c', 'bb883722-b049-428e-b35a-e2cf7bec24fa', '943e6921-12ba-47a0-8ff1-d15ced99007b', '1bae6137-4642-49ee-ace6-f6786bd7a60c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:02 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" returned: 0 in 0.434s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:02 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:02 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:02 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 1G Jul 17 15:47:02 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:02 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4" returned: 0 in 0.400s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:02 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4 Jul 17 15:47:02 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:02 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.260s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Deleted volume successfully. Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0260fac4-6df6-4e38-a6d0-a672ea54ae1c tempest-ProjectReaderTests-2034714694 None] Lock "cinder-d5497e76-a1f2-4c21-97a7-c438661fd3f4-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:02 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400.0332ce85-35f4-4439-9f08-7f8b9ae617a4" returned: 0 in 0.297s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-0332ce85-35f4-4439-9f08-7f8b9ae617a4" released by "_delete_snapshot" :: held 1.668s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-62c1c4d2-c197-4f94-8172-9de78fb32400" released by "delete_snapshot" :: held 1.691s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:02 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 1G" returned: 0 in 0.495s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:02 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 Jul 17 15:47:02 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Created reservations ['4aec3fbe-94bf-4afc-93a5-7369e68cebfe', '8a75f4bc-5266-4a2a-bf77-8ad3fefeebd6', '111538ce-2ee9-4f0c-9908-678fbb18079c', '33293301-7d61-43bf-88fa-2be83f2de40b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:02 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Delete snapshot completed successfully. Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-b02c4487-8397-4576-8111-85a13da3ddae tempest-ProjectMemberTests-2038443663 None] Lock "cinder-0332ce85-35f4-4439-9f08-7f8b9ae617a4-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:02 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426" returned: 0 in 0.317s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:02 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 is being set with open permissions: ugo+rw Jul 17 15:47:02 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:02 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 Jul 17 15:47:02 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-62c1c4d2-c197-4f94-8172-9de78fb32400-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-62c1c4d2-c197-4f94-8172-9de78fb32400-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-62c1c4d2-c197-4f94-8172-9de78fb32400" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-62c1c4d2-c197-4f94-8172-9de78fb32400" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbeaffe-0dc0-4cc9-a3a3-c06c6722af28]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:03 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426" returned: 0 in 0.302s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:03 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.info Jul 17 15:47:03 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:03 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 Jul 17 15:47:03 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:03 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.info" returned: 0 in 0.280s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:03 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.info is being set with open permissions: ugo+rw Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:03 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.info Jul 17 15:47:03 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:03 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400" returned: 0 in 0.411s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:03 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400 Jul 17 15:47:03 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:03 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.info" returned: 0 in 0.288s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:03 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-6df14c02-7ba4-4641-b270-2aa61913d3f9 tempest-ProjectReaderTests-1822403046 None] Create snapshot completed successfully Jul 17 15:47:03 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-62c1c4d2-c197-4f94-8172-9de78fb32400" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-62c1c4d2-c197-4f94-8172-9de78fb32400" released by "delete_volume" :: held 0.763s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:03 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Created reservations ['de50731f-172a-44d8-8c6b-70243f78c446', '10c510f4-9899-435e-8fde-f7d8871eed57', '80c6d164-2183-4a66-a5b0-81d06432c070', 'be42925b-2924-40b8-a36e-84f2d2ec7583'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:04 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:04 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:04 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.257s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:04 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Deleted volume successfully. Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-28562080-5223-4e0d-8598-9114523778d6 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-62c1c4d2-c197-4f94-8172-9de78fb32400-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (2fb8b60c-be13-4039-b2ab-a77a0fe82a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c678b8-8354-408b-b930-50490ee3877c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c678b8-8354-408b-b930-50490ee3877c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504128967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384a1635-1bb5-4fb8-9541-6b624cb56518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:05Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb7d7c4-a12b-45d8-ba90-2fe021477ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb7d7c4-a12b-45d8-ba90-2fe021477ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b0a3d6-3f1d-4296-a172-d9d2d0635e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b0a3d6-3f1d-4296-a172-d9d2d0635e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '384a1635-1bb5-4fb8-9541-6b624cb56518', 'volume_name': 'volume-384a1635-1bb5-4fb8-9541-6b624cb56518', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2169f3db-7ac7-47fb-8fdb-9af636b6a06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2169f3db-7ac7-47fb-8fdb-9af636b6a06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86a38fb-5777-42d3-ae45-4d90686e9f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:04 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Volume 384a1635-1bb5-4fb8-9541-6b624cb56518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-384a1635-1bb5-4fb8-9541-6b624cb56518', 'volume_size': 1} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504128967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384a1635-1bb5-4fb8-9541-6b624cb56518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:05Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Creating volume 384a1635-1bb5-4fb8-9541-6b624cb56518 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:04 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:04 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 1073741824 Jul 17 15:47:04 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-c79605a6-134a-4fc1-8e68-26affb540426-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Lock "cinder-c79605a6-134a-4fc1-8e68-26affb540426-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-c79605a6-134a-4fc1-8e68-26affb540426" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-c79605a6-134a-4fc1-8e68-26affb540426" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Deleting offline snapshot c79605a6-134a-4fc1-8e68-26affb540426 of volume 49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] snapshot_file for this snap is: volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acc9179-d52c-441d-8f50-34b48b4d3125]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:04 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:05 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 Jul 17 15:47:05 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:05 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 1073741824" returned: 0 in 0.438s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:05 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 Jul 17 15:47:05 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:05 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426" returned: 0 in 0.398s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb74bc51-47e9-419f-97ff-3249b8ebc3b9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:05 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 Jul 17 15:47:05 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:05 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86a38fb-5777-42d3-ae45-4d90686e9f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384a1635-1bb5-4fb8-9541-6b624cb56518', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18acfb50-5011-4c4c-9b67-1a2636f45dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:05 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Volume volume-384a1635-1bb5-4fb8-9541-6b624cb56518 (384a1635-1bb5-4fb8-9541-6b624cb56518): created successfully Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18acfb50-5011-4c4c-9b67-1a2636f45dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (2fb8b60c-be13-4039-b2ab-a77a0fe82a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:05 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-bd131623-5eb2-4485-ab8a-1d8f34948331 tempest-ProjectMemberTests-2038443663 None] Created volume successfully. Jul 17 15:47:05 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" returned: 0 in 0.379s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:05 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 Jul 17 15:47:05 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Creating offline snapshot b8dbd295-a472-43bc-8d97-33329f735ec7 of volume 384a1635-1bb5-4fb8-9541-6b624cb56518 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff755ac8-b61b-4cf3-aa0c-8ed221069fa8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:05 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:05 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 Jul 17 15:47:05 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:06 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426" returned: 0 in 0.362s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:06 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426 Jul 17 15:47:06 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:06 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518" returned: 0 in 0.372s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:06 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 1G Jul 17 15:47:06 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:06 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1.c79605a6-134a-4fc1-8e68-26affb540426" returned: 0 in 0.255s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-c79605a6-134a-4fc1-8e68-26affb540426" released by "_delete_snapshot" :: held 1.488s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" released by "delete_snapshot" :: held 1.512s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Created reservations ['fc433a1a-a16c-41f4-96cb-b9221cdec80b', '5d2110e2-a331-4a07-a492-99be7d440dd2', '848ff66e-a253-4743-aae6-80eb4078b3b4', '55a75c7b-ff03-4a40-bf6a-be1081978d86'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:06 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Delete snapshot completed successfully. Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-2fda5bd0-213a-43ac-9493-5c510b171bab tempest-ProjectReaderTests-1822403046 None] Lock "cinder-c79605a6-134a-4fc1-8e68-26affb540426-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:06 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 1G" returned: 0 in 0.391s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384a1635-1bb5-4fb8-9541-6b624cb56518 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:06 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384a1635-1bb5-4fb8-9541-6b624cb56518 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 Jul 17 15:47:06 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:06 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384a1635-1bb5-4fb8-9541-6b624cb56518 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:06 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 is being set with open permissions: ugo+rw Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:06 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 Jul 17 15:47:06 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:06 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Lock "cinder-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4415ad-0e0c-4e4f-8403-7f6b77a77316]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:07 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7" returned: 0 in 0.283s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:07 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 Jul 17 15:47:07 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:07 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.info Jul 17 15:47:07 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:07 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" returned: 0 in 0.364s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:07 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.info" returned: 0 in 0.253s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:07 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.info is being set with open permissions: ugo+rw Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:07 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1 Jul 17 15:47:07 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:07 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.info Jul 17 15:47:07 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:07 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" returned: 0 in 0.251s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1" released by "delete_volume" :: held 0.681s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:07 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.info" returned: 0 in 0.259s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:07 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-73b67393-b076-48ff-b1b9-29ba1ffff2e0 tempest-ProjectMemberTests-2038443663 None] Create snapshot completed successfully Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Created reservations ['451b244f-9561-4172-8cd7-0365f2fd61c2', 'b3cb8893-e32b-4d4a-924d-d4935422b36b', 'a1c31eb8-64ff-480c-8d67-3e3378d5103c', '4bbd091e-0432-4e60-94ea-162eaaffe607'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:07 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:07 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-b8dbd295-a472-43bc-8d97-33329f735ec7-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Lock "cinder-b8dbd295-a472-43bc-8d97-33329f735ec7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:07 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-384a1635-1bb5-4fb8-9541-6b624cb56518" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-384a1635-1bb5-4fb8-9541-6b624cb56518" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-b8dbd295-a472-43bc-8d97-33329f735ec7" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-b8dbd295-a472-43bc-8d97-33329f735ec7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Deleting offline snapshot b8dbd295-a472-43bc-8d97-33329f735ec7 of volume 384a1635-1bb5-4fb8-9541-6b624cb56518 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] snapshot_file for this snap is: volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81b0600-0c87-4e3e-911a-c5c2a1b384ea]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:08 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.265s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:08 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Deleted volume successfully. Jul 17 15:47:08 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 Jul 17 15:47:08 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1e0c8854-d3a1-4544-bcaf-d26681a6950e tempest-ProjectReaderTests-1822403046 None] Lock "cinder-49cbd0bd-9878-4896-9db5-8b1a71ea5bc1-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:08 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7" returned: 0 in 0.402s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384a1635-1bb5-4fb8-9541-6b624cb56518(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafee8f2-8684-4d54-86a3-443f54715774]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (34a372ba-1e80-44eb-8bb5-9a1713f855eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc2e2f9-4ce2-40f7-984c-7f8bf706a142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:08 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 Jul 17 15:47:08 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc2e2f9-4ce2-40f7-984c-7f8bf706a142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2035786032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed22cf2-131a-4366-9b51-7066d4416999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:09Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee78fc2-1cee-4586-95d8-378089bce966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee78fc2-1cee-4586-95d8-378089bce966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad57178-8231-4047-a3bc-e75e33d741b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad57178-8231-4047-a3bc-e75e33d741b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed22cf2-131a-4366-9b51-7066d4416999', 'volume_name': 'volume-4ed22cf2-131a-4366-9b51-7066d4416999', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ba05bc-1eea-4423-b298-694d6f4d6026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ba05bc-1eea-4423-b298-694d6f4d6026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950d61a9-c8dd-46c6-8c5b-674001f55cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:08 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Volume 4ed22cf2-131a-4366-9b51-7066d4416999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed22cf2-131a-4366-9b51-7066d4416999', 'volume_size': 1} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2035786032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed22cf2-131a-4366-9b51-7066d4416999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:09Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Creating volume 4ed22cf2-131a-4366-9b51-7066d4416999 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:08 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:08 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 1073741824 Jul 17 15:47:08 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:08 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518" returned: 0 in 0.371s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:08 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:08 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 Jul 17 15:47:08 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:09 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 1073741824" returned: 0 in 0.423s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:09 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 Jul 17 15:47:09 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:09 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7" returned: 0 in 0.381s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:09 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7 Jul 17 15:47:09 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:09 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999" returned: 0 in 0.256s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950d61a9-c8dd-46c6-8c5b-674001f55cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed22cf2-131a-4366-9b51-7066d4416999', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987f1eac-33c6-48c6-ab60-7713f44d7e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:09 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Volume volume-4ed22cf2-131a-4366-9b51-7066d4416999 (4ed22cf2-131a-4366-9b51-7066d4416999): created successfully Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987f1eac-33c6-48c6-ab60-7713f44d7e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (34a372ba-1e80-44eb-8bb5-9a1713f855eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-dd07db02-bac3-4fdb-b9fc-9458cb7ca255 tempest-ProjectReaderTests-1822403046 None] Created volume successfully. Jul 17 15:47:09 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518.b8dbd295-a472-43bc-8d97-33329f735ec7" returned: 0 in 0.259s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-b8dbd295-a472-43bc-8d97-33329f735ec7" released by "_delete_snapshot" :: held 1.517s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-384a1635-1bb5-4fb8-9541-6b624cb56518" released by "delete_snapshot" :: held 1.544s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Created reservations ['51dc3b67-e0c0-4522-830d-4e0c4fb51c03', '49dbe74c-4367-4f5b-a7a9-c54d75441b17', '0d8dbc93-549c-427e-b0ef-30ac28ce9f3b', 'e3c55d5f-a839-4acd-8784-4458dbccc9a3'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:09 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Delete snapshot completed successfully. Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-01a20cfa-4a4f-4d28-8122-d4ac9c90030e tempest-ProjectMemberTests-2038443663 None] Lock "cinder-b8dbd295-a472-43bc-8d97-33329f735ec7-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Creating offline snapshot cfe95f7d-62dc-40da-a843-9ff20a5c6321 of volume 4ed22cf2-131a-4366-9b51-7066d4416999 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c8bb73-2cda-43b2-a321-60f3f44e9b99]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:09 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:09 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 Jul 17 15:47:09 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-384a1635-1bb5-4fb8-9541-6b624cb56518-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Lock "cinder-384a1635-1bb5-4fb8-9541-6b624cb56518-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-384a1635-1bb5-4fb8-9541-6b624cb56518" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-384a1635-1bb5-4fb8-9541-6b624cb56518" acquired by "delete_volume" :: waited 0.013s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:10 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999" returned: 0 in 0.417s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c09d0f3-3e3e-41fa-bf5f-e3f14b2933d3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:10 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 1G Jul 17 15:47:10 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:10 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 Jul 17 15:47:10 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:10 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518" returned: 0 in 0.362s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:10 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518 Jul 17 15:47:10 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:10 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 1G" returned: 0 in 0.414s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed22cf2-131a-4366-9b51-7066d4416999 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:10 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed22cf2-131a-4366-9b51-7066d4416999 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 Jul 17 15:47:10 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:10 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-384a1635-1bb5-4fb8-9541-6b624cb56518" returned: 0 in 0.256s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-384a1635-1bb5-4fb8-9541-6b624cb56518" released by "delete_volume" :: held 0.677s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Created reservations ['8594673d-7d97-445d-b402-1257f9764acd', '98ea05b4-4ce4-4862-8601-d6c924bef9ec', '07362190-88f4-49ef-bdae-3bc5a889c153', '5ff37a1b-6027-4063-b9e9-2c7315ad8de1'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:10 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed22cf2-131a-4366-9b51-7066d4416999 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321" returned: 0 in 0.300s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:10 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 is being set with open permissions: ugo+rw Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:10 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 Jul 17 15:47:10 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:10 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:11 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:11 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:11 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321" returned: 0 in 0.253s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:11 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.info Jul 17 15:47:11 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:11 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.273s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Deleted volume successfully. Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-009fb539-c1a7-433c-9ff0-39b03acbb32f tempest-ProjectMemberTests-2038443663 None] Lock "cinder-384a1635-1bb5-4fb8-9541-6b624cb56518-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:11 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.info" returned: 0 in 0.282s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:11 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.info is being set with open permissions: ugo+rw Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:11 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.info Jul 17 15:47:11 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (c856c90b-bf60-4a1d-b47d-e8e51143b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e37ebc5-567c-47bb-b3e4-ab3a37c88f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e37ebc5-567c-47bb-b3e4-ab3a37c88f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977898805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7735e99-32d5-4f30-90f7-02653fcef0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:12Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:11 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3bec9d-076b-41e9-8edb-b869f0071704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3bec9d-076b-41e9-8edb-b869f0071704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3861b06c-b966-487b-a0a5-c177a750e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3861b06c-b966-487b-a0a5-c177a750e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7735e99-32d5-4f30-90f7-02653fcef0ac', 'volume_name': 'volume-d7735e99-32d5-4f30-90f7-02653fcef0ac', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be6ca81-1769-4cc3-8344-121bae4ac99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be6ca81-1769-4cc3-8344-121bae4ac99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce40e730-18df-44aa-a35d-9796dea83fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:11 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Volume d7735e99-32d5-4f30-90f7-02653fcef0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7735e99-32d5-4f30-90f7-02653fcef0ac', 'volume_size': 1} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.info" returned: 0 in 0.314s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977898805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7735e99-32d5-4f30-90f7-02653fcef0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:12Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Creating volume d7735e99-32d5-4f30-90f7-02653fcef0ac {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:11 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:11 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:11 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac 1073741824 Jul 17 15:47:11 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:11 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2c795f05-e96e-4e02-844d-6f9e87fb6a93 tempest-ProjectReaderTests-1822403046 None] Create snapshot completed successfully Jul 17 15:47:12 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac 1073741824" returned: 0 in 0.415s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:12 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac Jul 17 15:47:12 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:12 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac" returned: 0 in 0.244s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce40e730-18df-44aa-a35d-9796dea83fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7735e99-32d5-4f30-90f7-02653fcef0ac', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aedd894-254c-401b-b753-9deabb4c6969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:12 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Volume volume-d7735e99-32d5-4f30-90f7-02653fcef0ac (d7735e99-32d5-4f30-90f7-02653fcef0ac): created successfully Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aedd894-254c-401b-b753-9deabb4c6969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (c856c90b-bf60-4a1d-b47d-e8e51143b321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:12 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0f6c7c68-3db8-4c5d-9600-27e64ba880cd tempest-ProjectMemberTests-2038443663 None] Created volume successfully. Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Creating offline snapshot 389328ca-fbf2-4ba6-9bc4-43e0006e7a13 of volume d7735e99-32d5-4f30-90f7-02653fcef0ac {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b21de3e-a8e5-460d-a999-f755ff058137]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-cfe95f7d-62dc-40da-a843-9ff20a5c6321-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-cfe95f7d-62dc-40da-a843-9ff20a5c6321-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-4ed22cf2-131a-4366-9b51-7066d4416999" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-4ed22cf2-131a-4366-9b51-7066d4416999" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-cfe95f7d-62dc-40da-a843-9ff20a5c6321" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:12 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-cfe95f7d-62dc-40da-a843-9ff20a5c6321" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Deleting offline snapshot cfe95f7d-62dc-40da-a843-9ff20a5c6321 of volume 4ed22cf2-131a-4366-9b51-7066d4416999 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] snapshot_file for this snap is: volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f435ee-2a37-4536-a02e-a53f3e5f5032]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:13 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac Jul 17 15:47:13 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:13 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 Jul 17 15:47:13 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:13 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac" returned: 0 in 0.379s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:13 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 1G Jul 17 15:47:13 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:13 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321" returned: 0 in 0.375s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ed22cf2-131a-4366-9b51-7066d4416999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d593dd2-e52a-4b74-881c-960534a302a1]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:13 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 Jul 17 15:47:13 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:13 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 1G" returned: 0 in 0.383s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7735e99-32d5-4f30-90f7-02653fcef0ac -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:13 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7735e99-32d5-4f30-90f7-02653fcef0ac -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 Jul 17 15:47:13 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:13 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999" returned: 0 in 0.362s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:13 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 Jul 17 15:47:13 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:13 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7735e99-32d5-4f30-90f7-02653fcef0ac -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13" returned: 0 in 0.292s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:13 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 is being set with open permissions: ugo+rw Jul 17 15:47:13 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:14 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 Jul 17 15:47:14 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:14 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321" returned: 0 in 0.341s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:14 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321 Jul 17 15:47:14 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:14 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13" returned: 0 in 0.259s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:14 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.info Jul 17 15:47:14 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:14 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999.cfe95f7d-62dc-40da-a843-9ff20a5c6321" returned: 0 in 0.263s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-cfe95f7d-62dc-40da-a843-9ff20a5c6321" released by "_delete_snapshot" :: held 1.443s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-4ed22cf2-131a-4366-9b51-7066d4416999" released by "delete_snapshot" :: held 1.466s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Created reservations ['a65c7dac-b3aa-4930-bfe7-7d685b651d8e', '3140c20a-75e6-4217-b578-08cfeadb9c76', 'dfe47ae2-b51c-4ecc-9c49-ae31a8a9411b', '76c537d0-a8fe-4359-8828-68b986fd427d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:14 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.info" returned: 0 in 0.265s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:14 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.info is being set with open permissions: ugo+rw Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:14 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.info Jul 17 15:47:14 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Delete snapshot completed successfully. Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-051d4300-05bc-4cf9-a3df-77993af72f37 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-cfe95f7d-62dc-40da-a843-9ff20a5c6321-delete_snapshot" released by "delete_snapshot" :: held 1.628s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:14 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.info" returned: 0 in 0.235s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:14 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:14 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-57fbcd10-be0f-49e0-b89a-1023bc160814 tempest-ProjectMemberTests-2038443663 None] Create snapshot completed successfully Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-389328ca-fbf2-4ba6-9bc4-43e0006e7a13-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-389328ca-fbf2-4ba6-9bc4-43e0006e7a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-d7735e99-32d5-4f30-90f7-02653fcef0ac" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-d7735e99-32d5-4f30-90f7-02653fcef0ac" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-389328ca-fbf2-4ba6-9bc4-43e0006e7a13" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-389328ca-fbf2-4ba6-9bc4-43e0006e7a13" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Deleting offline snapshot 389328ca-fbf2-4ba6-9bc4-43e0006e7a13 of volume d7735e99-32d5-4f30-90f7-02653fcef0ac {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] snapshot_file for this snap is: volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[30086710-acce-4e1f-b449-26e5c04df921]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-4ed22cf2-131a-4366-9b51-7066d4416999-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Lock "cinder-4ed22cf2-131a-4366-9b51-7066d4416999-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-4ed22cf2-131a-4366-9b51-7066d4416999" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-4ed22cf2-131a-4366-9b51-7066d4416999" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:15 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 Jul 17 15:47:15 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbaff3d-f3eb-45e2-a9e4-426206c84401]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:15 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 Jul 17 15:47:15 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:15 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13" returned: 0 in 0.376s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7735e99-32d5-4f30-90f7-02653fcef0ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0478e4d-a9f6-43a7-9eb1-38a4c2e5ec6d]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:15 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999" returned: 0 in 0.360s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:15 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac Jul 17 15:47:15 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:15 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999 Jul 17 15:47:15 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:15 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-4ed22cf2-131a-4366-9b51-7066d4416999" returned: 0 in 0.254s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:15 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac" returned: 0 in 0.370s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-4ed22cf2-131a-4366-9b51-7066d4416999" released by "delete_volume" :: held 0.685s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:15 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 Jul 17 15:47:15 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Created reservations ['1023f30b-9e3a-4178-b197-66f34763f32e', '8b85cdca-5752-425f-977f-0449d2d96776', 'd41613d7-99de-4580-b3f6-26683b8ee241', 'b4ff8384-a34a-44dc-95bc-d31cb7ca9563'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:15 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:16 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:16 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:16 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13" returned: 0 in 0.357s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:16 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13 Jul 17 15:47:16 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:16 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.266s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Deleted volume successfully. Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-20c350fc-2171-4943-a8d3-174dba6de95f tempest-ProjectReaderTests-1822403046 None] Lock "cinder-4ed22cf2-131a-4366-9b51-7066d4416999-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:16 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac.389328ca-fbf2-4ba6-9bc4-43e0006e7a13" returned: 0 in 0.259s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-389328ca-fbf2-4ba6-9bc4-43e0006e7a13" released by "_delete_snapshot" :: held 1.461s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-d7735e99-32d5-4f30-90f7-02653fcef0ac" released by "delete_snapshot" :: held 1.488s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Created reservations ['b39c8d6b-3774-4adc-bcd1-181ad6d1ed3e', 'd20c127d-081f-4282-a8bd-55e7a146b41a', '7f945961-9461-435d-aaa4-a7dd1c51f144', 'e4498cea-1a9f-4bd1-8a40-19b9d475d9ba'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:16 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Delete snapshot completed successfully. Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-0a7f2b20-777b-49f8-9425-efab4588da07 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-389328ca-fbf2-4ba6-9bc4-43e0006e7a13-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (217541d4-1284-4204-b7f0-2a7c214e0b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f932ed0a-4c84-42f7-a11c-60b7d7350fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f932ed0a-4c84-42f7-a11c-60b7d7350fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979804244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad47903f-6f32-45fd-9971-bd628ef65032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:17Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c380fbd4-759f-4610-a857-b287e21e0ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c380fbd4-759f-4610-a857-b287e21e0ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa39f5d3-7d76-4367-8c0e-042606f86e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa39f5d3-7d76-4367-8c0e-042606f86e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad47903f-6f32-45fd-9971-bd628ef65032', 'volume_name': 'volume-ad47903f-6f32-45fd-9971-bd628ef65032', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f643be-9c9c-4431-b309-d3c6de581cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f643be-9c9c-4431-b309-d3c6de581cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afdeb2b-f97c-4b11-b331-1400749dcbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:16 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Volume ad47903f-6f32-45fd-9971-bd628ef65032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad47903f-6f32-45fd-9971-bd628ef65032', 'volume_size': 1} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979804244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad47903f-6f32-45fd-9971-bd628ef65032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c432889640c416d9b7e43a169b86141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:17Z,use_quota=True,user_id='7574566df1e649a38822ad354f5f9988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Creating volume ad47903f-6f32-45fd-9971-bd628ef65032 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:16 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:16 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:16 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 1073741824 Jul 17 15:47:16 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-d7735e99-32d5-4f30-90f7-02653fcef0ac-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Lock "cinder-d7735e99-32d5-4f30-90f7-02653fcef0ac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-d7735e99-32d5-4f30-90f7-02653fcef0ac" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-d7735e99-32d5-4f30-90f7-02653fcef0ac" acquired by "delete_volume" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:17 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 1073741824" returned: 0 in 0.481s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4befe9e-b98b-480b-a074-739dce2a1f46]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:17 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 Jul 17 15:47:17 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:17 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac Jul 17 15:47:17 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:17 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afdeb2b-f97c-4b11-b331-1400749dcbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad47903f-6f32-45fd-9971-bd628ef65032', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c27982-b94d-4832-886a-b4f334bf9f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:17 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Volume volume-ad47903f-6f32-45fd-9971-bd628ef65032 (ad47903f-6f32-45fd-9971-bd628ef65032): created successfully Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c27982-b94d-4832-886a-b4f334bf9f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Flow 'volume_create_manager' (217541d4-1284-4204-b7f0-2a7c214e0b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:17 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a4312fe5-ba72-4d23-a277-a3d5fbb9f007 tempest-ProjectReaderTests-1822403046 None] Created volume successfully. Jul 17 15:47:17 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac" returned: 0 in 0.379s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:17 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac Jul 17 15:47:17 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Creating offline snapshot 83c38fc5-7a91-46eb-be5c-5988447ce242 of volume ad47903f-6f32-45fd-9971-bd628ef65032 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:17 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-d7735e99-32d5-4f30-90f7-02653fcef0ac" returned: 0 in 0.263s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a6b4e-d5c2-466c-8c91-bc8f2efb0ea9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:17 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-d7735e99-32d5-4f30-90f7-02653fcef0ac" released by "delete_volume" :: held 0.710s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Created reservations ['d702e63a-c335-47bb-8e48-11894b82b6e6', 'd69b6bff-bd2a-438a-b831-c41001ba4dd2', '0ab2ee38-7596-4b2e-9ce4-85738aebd852', '46fad287-0319-4324-80a3-871200e6b20d'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:18 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 Jul 17 15:47:18 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:18 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:18 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:18 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032" returned: 0 in 0.360s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:18 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 1G Jul 17 15:47:18 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:18 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.271s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:18 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Deleted volume successfully. Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-542ecf2d-714a-4223-872f-45f35266820d tempest-ProjectMemberTests-2038443663 None] Lock "cinder-d7735e99-32d5-4f30-90f7-02653fcef0ac-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:18 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 1G" returned: 0 in 0.440s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad47903f-6f32-45fd-9971-bd628ef65032 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:18 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad47903f-6f32-45fd-9971-bd628ef65032 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 Jul 17 15:47:18 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (e57147ee-aadb-439d-a02f-3d7c77362281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaef951b-7d4b-445a-9878-b17a74587435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaef951b-7d4b-445a-9878-b17a74587435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73291798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:19Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185b78ce-305a-41ac-b792-c5f9621b6bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185b78ce-305a-41ac-b792-c5f9621b6bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f63749c-69e6-49b7-a55c-21835f4b6dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f63749c-69e6-49b7-a55c-21835f4b6dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b', 'volume_name': 'volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a079f1-5c9d-4fff-bd6c-bca067312dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a079f1-5c9d-4fff-bd6c-bca067312dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406294b3-3a9b-490d-81ee-0ea562dead39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:18 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Volume b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b', 'volume_size': 1} Jul 17 15:47:18 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:19 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad47903f-6f32-45fd-9971-bd628ef65032 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242" returned: 0 in 0.309s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:19 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 is being set with open permissions: ugo+rw Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:19 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 Jul 17 15:47:19 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:19 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242" returned: 0 in 0.246s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:19 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.info Jul 17 15:47:19 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:19 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.info" returned: 0 in 0.241s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:19 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.info is being set with open permissions: ugo+rw Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:19 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.info Jul 17 15:47:19 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:19 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.info" returned: 0 in 0.246s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73291798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:19Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Creating volume b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:19 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:19 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:19 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b 1073741824 Jul 17 15:47:19 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:19 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e349d914-3c77-4e91-a6f0-c70eae915807 tempest-ProjectReaderTests-1822403046 None] Create snapshot completed successfully Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-83c38fc5-7a91-46eb-be5c-5988447ce242-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-83c38fc5-7a91-46eb-be5c-5988447ce242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-ad47903f-6f32-45fd-9971-bd628ef65032" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-ad47903f-6f32-45fd-9971-bd628ef65032" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-83c38fc5-7a91-46eb-be5c-5988447ce242" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-83c38fc5-7a91-46eb-be5c-5988447ce242" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Deleting offline snapshot 83c38fc5-7a91-46eb-be5c-5988447ce242 of volume ad47903f-6f32-45fd-9971-bd628ef65032 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] snapshot_file for this snap is: volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abede06-c81a-4090-aee5-66e5cbb46601]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:20 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 Jul 17 15:47:20 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:20 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b 1073741824" returned: 0 in 0.510s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:20 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b Jul 17 15:47:20 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:20 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242" returned: 0 in 0.372s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad47903f-6f32-45fd-9971-bd628ef65032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6595a2c-3498-4e1e-818f-a3a23fd97324]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:20 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" returned: 0 in 0.257s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406294b3-3a9b-490d-81ee-0ea562dead39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7dd350-8bec-4ff6-be1f-6aa180b0cc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:20 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Volume volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b (b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b): created successfully Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7dd350-8bec-4ff6-be1f-6aa180b0cc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (e57147ee-aadb-439d-a02f-3d7c77362281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:20 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-552ea447-f55b-4666-ac5a-48e340eb48aa tempest-ProjectMemberTests-2038443663 None] Created volume successfully. Jul 17 15:47:20 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 Jul 17 15:47:20 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:20 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032" returned: 0 in 0.380s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:20 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:21 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 Jul 17 15:47:21 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Creating offline snapshot c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 of volume b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1a2d7-499e-436d-bbf7-e7f80f242812]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:21 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b Jul 17 15:47:21 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:21 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242" returned: 0 in 0.347s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:21 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242 Jul 17 15:47:21 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:21 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" returned: 0 in 0.379s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:21 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 1G Jul 17 15:47:21 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:21 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032.83c38fc5-7a91-46eb-be5c-5988447ce242" returned: 0 in 0.254s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-83c38fc5-7a91-46eb-be5c-5988447ce242" released by "_delete_snapshot" :: held 1.448s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-ad47903f-6f32-45fd-9971-bd628ef65032" released by "delete_snapshot" :: held 1.476s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Created reservations ['e0135f02-2e45-4825-adde-0e508244a519', 'f7b0e99b-47d0-4c35-bfaa-f5ce2385af36', '66bf7d90-7b0e-4416-8b4f-a6831e783ec5', '08052caf-9816-4969-a37a-0f41c9c50e5a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:21 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Delete snapshot completed successfully. Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e9840396-c333-4e97-9d16-8a773e9e7577 tempest-ProjectReaderTests-1822403046 None] Lock "cinder-83c38fc5-7a91-46eb-be5c-5988447ce242-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:21 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 1G" returned: 0 in 0.394s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:21 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:21 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 Jul 17 15:47:21 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:22 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:22 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 is being set with open permissions: ugo+rw Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:22 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 Jul 17 15:47:22 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-ad47903f-6f32-45fd-9971-bd628ef65032-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Lock "cinder-ad47903f-6f32-45fd-9971-bd628ef65032-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Acquiring lock "cinder-quobyte-ad47903f-6f32-45fd-9971-bd628ef65032" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-ad47903f-6f32-45fd-9971-bd628ef65032" acquired by "delete_volume" :: waited 0.013s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b37be77-c332-4bcf-a76c-8fd0b708f50e]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:22 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9" returned: 0 in 0.262s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:22 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.info Jul 17 15:47:22 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:22 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 Jul 17 15:47:22 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:22 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.info" returned: 0 in 0.251s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:22 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.info is being set with open permissions: ugo+rw Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:22 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.info Jul 17 15:47:22 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:22 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032" returned: 0 in 0.355s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:22 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032 Jul 17 15:47:22 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:22 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:22 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:22 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.info" returned: 0 in 0.249s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:22 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-af46e04a-9274-4985-8b7b-d969ac05134b tempest-ProjectMemberTests-2038443663 None] Create snapshot completed successfully Jul 17 15:47:22 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ad47903f-6f32-45fd-9971-bd628ef65032" returned: 0 in 0.265s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Lock "cinder-quobyte-ad47903f-6f32-45fd-9971-bd628ef65032" released by "delete_volume" :: held 0.693s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Created reservations ['d8cb6322-23da-4795-a135-589d952b57d3', 'ef035631-0dda-4c51-ae31-82c1d214b5e5', '2e3e9b3f-9b80-471b-ae53-7ee11188af5a', '9e0a5a4f-1e8b-455c-9333-d46533fad167'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:23 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.272s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:23 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:23 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Deleting offline snapshot c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 of volume b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] snapshot_file for this snap is: volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c08d22-de2b-417c-b083-c3a6e6d1f4d3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:23 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 Jul 17 15:47:23 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:23 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.273s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Deleted volume successfully. Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-97e1f9f3-3170-478a-aa4d-3801b1589bed tempest-ProjectReaderTests-1822403046 None] Lock "cinder-ad47903f-6f32-45fd-9971-bd628ef65032-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:23 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9" returned: 0 in 0.372s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[14258eb6-e304-4e66-a243-250d9e2a4eb0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:23 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b Jul 17 15:47:23 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:24 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" returned: 0 in 0.364s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:24 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 Jul 17 15:47:24 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:24 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9" returned: 0 in 0.359s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:24 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9 Jul 17 15:47:24 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:24 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b.c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9" returned: 0 in 0.244s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9" released by "_delete_snapshot" :: held 1.445s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" released by "delete_snapshot" :: held 1.468s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:24 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Created reservations ['2d3667c6-d0ba-443b-bbc8-a6031aa056ac', 'da77bdc2-ac2c-4cee-acc2-13a9c0bd3483', 'c6e7352d-0bcd-4ee2-814d-ec5446e828a9', 'f826a0bd-d7ba-42a7-8409-4c8344a2d871'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:24 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Delete snapshot completed successfully. Jul 17 15:47:24 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a6fc03f4-d252-429c-b02b-215a708d08e3 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-c4c5a4a6-0f8d-4cbd-806c-96b65766d8a9-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Lock "cinder-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:25 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" acquired by "delete_volume" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:25 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37e53b9-9f8c-4d9c-bbfe-e5150ee4e2b5]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:25 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b Jul 17 15:47:25 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:25 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" returned: 0 in 0.365s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:25 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b Jul 17 15:47:25 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:26 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" returned: 0 in 0.260s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b" released by "delete_volume" :: held 0.689s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Created reservations ['38744a85-7431-469e-aa3f-6c51201d5b93', 'fdc5c23f-66bb-43bf-a305-c0c9b389a457', '9887b18c-e5f8-4a3d-b842-698562bc59ed', 'af385951-8c23-4c87-a93a-290ed453757a'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:26 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:26 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:26 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.271s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:26 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Deleted volume successfully. Jul 17 15:47:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-8f8f0597-d119-4c68-b67d-b2d88ffd3dcb tempest-ProjectMemberTests-2038443663 None] Lock "cinder-b9c4a0c8-21d4-4c7d-b75c-794f5eb2404b-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (542d3344-adfe-442f-8823-c958cebde9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318dbad5-70c6-4130-a5e2-f7900be618a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318dbad5-70c6-4130-a5e2-f7900be618a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839244377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12cd4a5-6649-40b6-9cc6-f3b8d67a385f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:27Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67041d82-2523-4bba-afab-54ccd26267cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67041d82-2523-4bba-afab-54ccd26267cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0680fb4-117e-4b99-a9f1-6cbee0307213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0680fb4-117e-4b99-a9f1-6cbee0307213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12cd4a5-6649-40b6-9cc6-f3b8d67a385f', 'volume_name': 'volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f28f2a-0b95-4462-a6eb-5cf969d5eddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f28f2a-0b95-4462-a6eb-5cf969d5eddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fea7513-3138-4bed-8350-50a522d3ab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:27 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Volume a12cd4a5-6649-40b6-9cc6-f3b8d67a385f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f', 'volume_size': 1} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839244377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12cd4a5-6649-40b6-9cc6-f3b8d67a385f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:27Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Creating volume a12cd4a5-6649-40b6-9cc6-f3b8d67a385f {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:27 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:27 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f 1073741824 Jul 17 15:47:27 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:27 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f 1073741824" returned: 0 in 0.486s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:27 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f Jul 17 15:47:27 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:27 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" returned: 0 in 0.260s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fea7513-3138-4bed-8350-50a522d3ab7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b2907c-8927-4198-bf5e-c5c49e38a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:27 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Volume volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f (a12cd4a5-6649-40b6-9cc6-f3b8d67a385f): created successfully Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b2907c-8927-4198-bf5e-c5c49e38a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:27 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (542d3344-adfe-442f-8823-c958cebde9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:27 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-c383aafb-34d6-4b69-b527-f7568e819a49 tempest-ProjectMemberTests-2038443663 None] Created volume successfully. Jul 17 15:47:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:29 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Creating offline snapshot 01d95838-a3f0-4235-acee-c07d2ff453ee of volume a12cd4a5-6649-40b6-9cc6-f3b8d67a385f {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:29 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d81ac0-3ca4-40bb-9a23-543c8083fdf2]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:29 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f Jul 17 15:47:29 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:29 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" returned: 0 in 0.404s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:29 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:29 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee 1G Jul 17 15:47:29 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:30 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee 1G" returned: 0 in 0.397s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:30 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee Jul 17 15:47:30 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:30 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee" returned: 0 in 0.278s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:30 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee is being set with open permissions: ugo+rw Jul 17 15:47:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:30 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee Jul 17 15:47:30 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:30 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee" returned: 0 in 0.237s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:30 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.info Jul 17 15:47:30 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:30 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.info" returned: 0 in 0.239s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:30 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.info is being set with open permissions: ugo+rw Jul 17 15:47:30 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:30 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.info Jul 17 15:47:30 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:31 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.info" returned: 0 in 0.246s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:31 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-2e153a1c-c07b-4741-8c07-f4f5b6e64d67 tempest-ProjectMemberTests-2038443663 None] Create snapshot completed successfully Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-01d95838-a3f0-4235-acee-c07d2ff453ee-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-01d95838-a3f0-4235-acee-c07d2ff453ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-01d95838-a3f0-4235-acee-c07d2ff453ee" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-01d95838-a3f0-4235-acee-c07d2ff453ee" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Deleting offline snapshot 01d95838-a3f0-4235-acee-c07d2ff453ee of volume a12cd4a5-6649-40b6-9cc6-f3b8d67a385f {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] snapshot_file for this snap is: volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a41a41d-51d9-4f55-88c8-5df91b62dff4]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:31 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee Jul 17 15:47:31 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:31 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee" returned: 0 in 0.352s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82b5ee7-b9df-4881-959f-f811ff653312]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:31 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f Jul 17 15:47:31 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:32 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" returned: 0 in 0.356s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:32 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee Jul 17 15:47:32 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:32 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee" returned: 0 in 0.329s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:32 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee Jul 17 15:47:32 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:32 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f.01d95838-a3f0-4235-acee-c07d2ff453ee" returned: 0 in 0.241s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-01d95838-a3f0-4235-acee-c07d2ff453ee" released by "_delete_snapshot" :: held 1.375s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" released by "delete_snapshot" :: held 1.398s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:32 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Created reservations ['aaacfd1a-7b45-4941-994f-086604387b57', '8185fe3f-7d8c-49a7-837f-f70be9d33218', '3dd0a7f1-316a-4878-8449-c328f5c89f77', 'ecb097f7-0956-4b44-8ae4-102414f1a9ff'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Delete snapshot completed successfully. Jul 17 15:47:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-f66960b5-a571-4ee3-ac07-5ede1d02f744 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-01d95838-a3f0-4235-acee-c07d2ff453ee-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Lock "cinder-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" acquired by "delete_volume" :: waited 0.013s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:33 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd18c52d-dd85-4198-9f56-a9956b324ce3]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:33 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f Jul 17 15:47:33 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:33 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" returned: 0 in 0.350s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:33 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f Jul 17 15:47:33 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:34 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f" released by "delete_volume" :: held 0.648s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Created reservations ['dedacbe1-2899-486d-be70-e36e2163d60c', '505438c2-f401-4f69-9f4d-e6c609655595', 'd1d7681d-4b19-42bc-ad69-14de199d653e', '7dc6e9d4-2002-48b1-b828-b182ec4084a8'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:34 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:34 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:34 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.247s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:34 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Deleted volume successfully. Jul 17 15:47:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-08fbe25d-5ce8-47f8-8404-5bc1d9fa84ff tempest-ProjectMemberTests-2038443663 None] Lock "cinder-a12cd4a5-6649-40b6-9cc6-f3b8d67a385f-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (7fca1f8a-5601-4ca2-a855-6e4597637f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96412fe-464e-4985-b122-fe25bb06ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96412fe-464e-4985-b122-fe25bb06ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-176815312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f39e6a-7d5e-49a9-bf6f-db44afeaa01b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:35Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a90fd3-81ad-49f6-86c1-951d4dcaee33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a90fd3-81ad-49f6-86c1-951d4dcaee33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e4b69c-6285-4e12-ac99-b082ed135cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e4b69c-6285-4e12-ac99-b082ed135cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f39e6a-7d5e-49a9-bf6f-db44afeaa01b', 'volume_name': 'volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61f6940-8a22-4b1d-aec3-0ef5d0f67144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61f6940-8a22-4b1d-aec3-0ef5d0f67144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb8b1f2-e5b6-4a57-82c6-16e99d9d6e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:35 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Volume 34f39e6a-7d5e-49a9-bf6f-db44afeaa01b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b', 'volume_size': 1} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-176815312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f39e6a-7d5e-49a9-bf6f-db44afeaa01b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:35Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Creating volume 34f39e6a-7d5e-49a9-bf6f-db44afeaa01b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:35 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:35 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b 1073741824 Jul 17 15:47:35 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:35 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b 1073741824" returned: 0 in 0.406s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:35 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b Jul 17 15:47:35 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:35 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb8b1f2-e5b6-4a57-82c6-16e99d9d6e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18ca88f-dc57-4b56-80d5-ef598d9c9f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:35 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Volume volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b (34f39e6a-7d5e-49a9-bf6f-db44afeaa01b): created successfully Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18ca88f-dc57-4b56-80d5-ef598d9c9f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:35 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (7fca1f8a-5601-4ca2-a855-6e4597637f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:35 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5cd8c16c-068d-4f91-bbea-505d3d738638 tempest-ProjectMemberTests-2038443663 None] Created volume successfully. Jul 17 15:47:36 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=289,cinder:DELETE=29,cinder:SELECT=220,cinder:INSERT=76 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:47:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Creating offline snapshot dc7109fc-afdf-46bd-8214-ff4562d2a487 of volume 34f39e6a-7d5e-49a9-bf6f-db44afeaa01b {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:36 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea719e15-db53-42a9-ba35-6fbd4fbccf69]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:36 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b Jul 17 15:47:36 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:36 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" returned: 0 in 0.348s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:36 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 1G Jul 17 15:47:36 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:37 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 1G" returned: 0 in 0.376s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:37 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 Jul 17 15:47:37 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:37 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487" returned: 0 in 0.286s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:37 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 is being set with open permissions: ugo+rw Jul 17 15:47:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:37 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 Jul 17 15:47:37 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:37 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487" returned: 0 in 0.235s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:37 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.info Jul 17 15:47:37 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:37 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.info" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:37 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.info is being set with open permissions: ugo+rw Jul 17 15:47:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:37 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.info Jul 17 15:47:37 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:38 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.info" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:38 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-89a2e48c-aa11-4383-b613-1aa585560fa6 tempest-ProjectMemberTests-2038443663 None] Create snapshot completed successfully Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-dc7109fc-afdf-46bd-8214-ff4562d2a487-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Lock "cinder-dc7109fc-afdf-46bd-8214-ff4562d2a487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-dc7109fc-afdf-46bd-8214-ff4562d2a487" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-dc7109fc-afdf-46bd-8214-ff4562d2a487" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Deleting offline snapshot dc7109fc-afdf-46bd-8214-ff4562d2a487 of volume 34f39e6a-7d5e-49a9-bf6f-db44afeaa01b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] snapshot_file for this snap is: volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b74a866-b184-4e81-ae5a-e90d7c1258e8]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:38 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 Jul 17 15:47:38 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:38 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487" returned: 0 in 0.354s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01dc177-667a-4052-9d9a-fc8604861b17]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:38 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:38 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b Jul 17 15:47:38 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:39 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" returned: 0 in 0.355s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:39 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 Jul 17 15:47:39 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:39 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487" returned: 0 in 0.325s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:39 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487 Jul 17 15:47:39 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:39 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b.dc7109fc-afdf-46bd-8214-ff4562d2a487" returned: 0 in 0.238s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-dc7109fc-afdf-46bd-8214-ff4562d2a487" released by "_delete_snapshot" :: held 1.355s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" released by "delete_snapshot" :: held 1.376s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=206,cinder:INSERT=73,cinder:UPDATE=278,cinder:DELETE=20 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Created reservations ['34edab57-c614-42a3-a625-59cc9caf9efc', '358856e5-d348-4683-8c9f-444e11e39260', '9a04cc28-698d-4fb1-92f2-3f0a63583804', 'b7656b9c-7c3d-4a2e-98ce-738221e7cd29'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:39 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Delete snapshot completed successfully. Jul 17 15:47:39 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e49a09e-9a50-41a7-b00c-55f458408eed tempest-ProjectMemberTests-2038443663 None] Lock "cinder-dc7109fc-afdf-46bd-8214-ff4562d2a487-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Lock "cinder-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:40 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:40 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98d44d6-1c8a-4775-9a4a-95771eb108e0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:40 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b Jul 17 15:47:40 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:40 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" returned: 0 in 0.361s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:40 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:41 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b Jul 17 15:47:41 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:41 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" returned: 0 in 0.248s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b" released by "delete_volume" :: held 0.664s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Created reservations ['667bce72-7c19-4c03-a5d3-66872c266688', '75ae6d55-03ff-44fa-a06c-a1ac36df521c', 'd2bcbf64-49b9-4d54-b545-468132f5051f', 'c4203e52-cad5-42f0-a58e-761064500036'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:41 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:41 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:41 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.245s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:41 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Deleted volume successfully. Jul 17 15:47:41 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-ab420355-5c66-4d31-a8e7-875f53cc195d tempest-ProjectMemberTests-2038443663 None] Lock "cinder-34f39e6a-7d5e-49a9-bf6f-db44afeaa01b-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (b3b0bf05-052d-44bc-8dc3-9a24a8d79491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacf6457-d2a9-4d01-97d6-b604f2050058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacf6457-d2a9-4d01-97d6-b604f2050058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962506588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c050c71-0702-4277-ad69-096f8e12690b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:42Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a52bcbe-891f-43f3-9926-7f8b9dd78556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a52bcbe-891f-43f3-9926-7f8b9dd78556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9012386-b53d-43b9-b1ca-1a68703e1a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9012386-b53d-43b9-b1ca-1a68703e1a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c050c71-0702-4277-ad69-096f8e12690b', 'volume_name': 'volume-0c050c71-0702-4277-ad69-096f8e12690b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba58839e-70bf-4e57-9d42-3bddb98e7919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba58839e-70bf-4e57-9d42-3bddb98e7919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4030a392-47bd-4a18-afb8-c67e08d97b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:42 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Volume 0c050c71-0702-4277-ad69-096f8e12690b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c050c71-0702-4277-ad69-096f8e12690b', 'volume_size': 1} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962506588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c050c71-0702-4277-ad69-096f8e12690b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:42Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Creating volume 0c050c71-0702-4277-ad69-096f8e12690b {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:42 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:42 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b 1073741824 Jul 17 15:47:42 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:42 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b 1073741824" returned: 0 in 0.397s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:42 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b Jul 17 15:47:42 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:42 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b" returned: 0 in 0.240s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4030a392-47bd-4a18-afb8-c67e08d97b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c050c71-0702-4277-ad69-096f8e12690b', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d4348f-7696-4777-bc1e-d9ec478577e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:42 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Volume volume-0c050c71-0702-4277-ad69-096f8e12690b (0c050c71-0702-4277-ad69-096f8e12690b): created successfully Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d4348f-7696-4777-bc1e-d9ec478577e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:42 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (b3b0bf05-052d-44bc-8dc3-9a24a8d79491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:42 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9c6fe2e1-8e7a-4374-ab8f-fa6435b85679 tempest-ProjectMemberTests-2038443663 None] Created volume successfully. Jul 17 15:47:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:43 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Creating offline snapshot ac0f8981-2328-4e54-a846-ba44c6f76809 of volume 0c050c71-0702-4277-ad69-096f8e12690b {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:43 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6213bb14-da09-4891-96a1-968bef6db1e7]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:43 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b Jul 17 15:47:43 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:43 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b" returned: 0 in 0.349s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:43 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:43 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 1G Jul 17 15:47:43 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:44 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 1G" returned: 0 in 0.383s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c050c71-0702-4277-ad69-096f8e12690b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:44 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c050c71-0702-4277-ad69-096f8e12690b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 Jul 17 15:47:44 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:44 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c050c71-0702-4277-ad69-096f8e12690b -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809" returned: 0 in 0.290s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:44 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 is being set with open permissions: ugo+rw Jul 17 15:47:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:44 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 Jul 17 15:47:44 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:44 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809" returned: 0 in 0.244s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:44 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.info Jul 17 15:47:44 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:44 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.info" returned: 0 in 0.242s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:44 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.info is being set with open permissions: ugo+rw Jul 17 15:47:44 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:44 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.info Jul 17 15:47:44 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:45 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.info" returned: 0 in 0.237s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:45 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fc1aa94d-7e4f-493a-8dfb-7f621254c7ba tempest-ProjectMemberTests-2038443663 None] Create snapshot completed successfully Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-ac0f8981-2328-4e54-a846-ba44c6f76809-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-ac0f8981-2328-4e54-a846-ba44c6f76809-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-0c050c71-0702-4277-ad69-096f8e12690b" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-0c050c71-0702-4277-ad69-096f8e12690b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-ac0f8981-2328-4e54-a846-ba44c6f76809" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-ac0f8981-2328-4e54-a846-ba44c6f76809" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Deleting offline snapshot ac0f8981-2328-4e54-a846-ba44c6f76809 of volume 0c050c71-0702-4277-ad69-096f8e12690b {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] snapshot_file for this snap is: volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a60285-c932-4bf0-a881-d30d60b47f52]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:45 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 Jul 17 15:47:45 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:45 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809" returned: 0 in 0.345s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c050c71-0702-4277-ad69-096f8e12690b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435b12d-ca4e-4565-8908-f6360b60b9c9]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:45 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:45 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b Jul 17 15:47:45 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:46 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b" returned: 0 in 0.366s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:46 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 Jul 17 15:47:46 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:46 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809" returned: 0 in 0.319s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:46 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809 Jul 17 15:47:46 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:46 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:46 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b.ac0f8981-2328-4e54-a846-ba44c6f76809" returned: 0 in 0.240s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-ac0f8981-2328-4e54-a846-ba44c6f76809" released by "_delete_snapshot" :: held 1.361s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-0c050c71-0702-4277-ad69-096f8e12690b" released by "delete_snapshot" :: held 1.385s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:46 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Created reservations ['0f96a1cd-f863-43d5-9ca5-8a538b9b0585', '904c6a1f-1ff3-4d43-b1da-fc0f8b6ec4cb', 'c516fcc2-1587-4914-8d6a-0452abe4b662', 'fc60c294-0c6a-4f71-b6dc-d455abb48104'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:46 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Delete snapshot completed successfully. Jul 17 15:47:46 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-5e43d06e-0057-4b85-9156-8cc3d2336c96 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-ac0f8981-2328-4e54-a846-ba44c6f76809-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-0c050c71-0702-4277-ad69-096f8e12690b-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-0c050c71-0702-4277-ad69-096f8e12690b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-0c050c71-0702-4277-ad69-096f8e12690b" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:47 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-0c050c71-0702-4277-ad69-096f8e12690b" acquired by "delete_volume" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:47 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b13e3ca-6a3e-4bf0-b91e-5f1d86267939]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:47 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:47 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b Jul 17 15:47:47 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:48 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b" returned: 0 in 0.358s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:48 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b Jul 17 15:47:48 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:48 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-0c050c71-0702-4277-ad69-096f8e12690b" returned: 0 in 0.249s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-0c050c71-0702-4277-ad69-096f8e12690b" released by "delete_volume" :: held 0.659s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Created reservations ['a0afd984-ad66-48c3-99e8-278d71a6e4cc', 'ddc7ca03-a57b-4175-acff-804a2d121ffe', '94575d95-fc50-4018-a3e0-82c2b95acd8b', 'd3c88401-d8df-4562-9023-ce4271857df4'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:48 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:48 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:48 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.241s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:48 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Deleted volume successfully. Jul 17 15:47:48 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-9f171bfc-3323-4995-b2a9-809703b4f2b9 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-0c050c71-0702-4277-ad69-096f8e12690b-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (fa3520f1-f847-4284-912b-fd45af3c6051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb62978e-24dc-45b1-bca8-deeea9734e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb62978e-24dc-45b1-bca8-deeea9734e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847086308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b89ed2-a5ee-4ca1-8b6c-334434f174f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:49Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2ab6ca-60c4-4dec-92f1-de362929478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2ab6ca-60c4-4dec-92f1-de362929478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082f2ed-5e3e-4206-be8c-3aead83c1cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082f2ed-5e3e-4206-be8c-3aead83c1cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b89ed2-a5ee-4ca1-8b6c-334434f174f5', 'volume_name': 'volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6409a1f9-afed-4032-9647-e81d2978378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6409a1f9-afed-4032-9647-e81d2978378e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471f6b14-f4f4-44f6-a165-aec6cdce176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:49 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Volume a4b89ed2-a5ee-4ca1-8b6c-334434f174f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5', 'volume_size': 1} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847086308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b89ed2-a5ee-4ca1-8b6c-334434f174f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676159a66f454afe9eec13dc1ae79330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:47:49Z,use_quota=True,user_id='223f394232d943dcb9715f03e68eb57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Creating volume a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:47:49 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:49 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 1073741824 Jul 17 15:47:49 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:49 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 1073741824" returned: 0 in 0.404s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:49 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 Jul 17 15:47:49 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:49 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" returned: 0 in 0.245s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471f6b14-f4f4-44f6-a165-aec6cdce176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d71485-7d2f-4816-8c40-a6a59713d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:47:49 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Volume volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 (a4b89ed2-a5ee-4ca1-8b6c-334434f174f5): created successfully Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d71485-7d2f-4816-8c40-a6a59713d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:47:49 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Flow 'volume_create_manager' (fa3520f1-f847-4284-912b-fd45af3c6051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:47:49 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-88984316-30cb-4950-9515-13ca1df1cfd5 tempest-ProjectMemberTests-2038443663 None] Created volume successfully. Jul 17 15:47:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:50 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Creating offline snapshot 2895d8fd-c4a2-46df-805d-320c09da43a6 of volume a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:47:50 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b45ddcb-c035-496b-98c6-96397c654564]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:50 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 Jul 17 15:47:50 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:50 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" returned: 0 in 0.343s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:50 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:50 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 1G Jul 17 15:47:50 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:51 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 1G" returned: 0 in 0.387s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:51 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 Jul 17 15:47:51 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:51 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6" returned: 0 in 0.287s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:51 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 is being set with open permissions: ugo+rw Jul 17 15:47:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:51 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 Jul 17 15:47:51 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:51 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6" returned: 0 in 0.233s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:51 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.info Jul 17 15:47:51 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:51 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.info" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:51 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.info is being set with open permissions: ugo+rw Jul 17 15:47:51 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:51 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.info Jul 17 15:47:51 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:52 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.info" returned: 0 in 0.239s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:52 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a95990fa-153d-4116-a22e-f06151afe3d7 tempest-ProjectMemberTests-2038443663 None] Create snapshot completed successfully Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-2895d8fd-c4a2-46df-805d-320c09da43a6-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-2895d8fd-c4a2-46df-805d-320c09da43a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-2895d8fd-c4a2-46df-805d-320c09da43a6" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-2895d8fd-c4a2-46df-805d-320c09da43a6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Deleting offline snapshot 2895d8fd-c4a2-46df-805d-320c09da43a6 of volume a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] snapshot_file for this snap is: volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[64173c9d-9c3f-47b1-af46-34d6f2a3b457]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:52 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 Jul 17 15:47:52 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:52 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6" returned: 0 in 0.350s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d077847-57e2-45b2-b8e8-ee7a8c1d2764]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:52 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:53 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 Jul 17 15:47:53 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:53 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" returned: 0 in 0.347s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:53 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 Jul 17 15:47:53 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:53 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6" returned: 0 in 0.327s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:53 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6 Jul 17 15:47:53 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:53 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:53 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5.2895d8fd-c4a2-46df-805d-320c09da43a6" returned: 0 in 0.253s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-2895d8fd-c4a2-46df-805d-320c09da43a6" released by "_delete_snapshot" :: held 1.363s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:53 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" released by "delete_snapshot" :: held 1.383s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:53 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Created reservations ['16de7b9d-d184-463d-86c5-9c7f065f78d3', '494dd482-1bf3-4d4c-ad1c-b3cc22456564', '357f6552-a344-49c9-a1a0-a0d4dc7ba8da', '80bab1d7-7ac7-4d62-93c8-4a922c38702c'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:54 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Delete snapshot completed successfully. Jul 17 15:47:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-43bd70ce-c190-4439-b390-ccee6ed36616 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-2895d8fd-c4a2-46df-805d-320c09da43a6-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "cinder-quobyte-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:47:54 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:47:54 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0d20c5-5323-4313-bec2-c5dd163dc7d0]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:47:54 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:54 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 Jul 17 15:47:54 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:55 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" returned: 0 in 0.346s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:55 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5 Jul 17 15:47:55 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:55 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" returned: 0 in 0.240s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-quobyte-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5" released by "delete_volume" :: held 0.643s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Created reservations ['99a1d1aa-840f-418c-aebf-c8c64dbfdae7', 'cbe0121c-0fdc-4b57-bfc5-bc9ae2105d36', '3d05e79a-1083-4202-87e2-f7d2ca265bed', '6f245d2f-47fe-4c4f-a25f-53b02167900b'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:47:55 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:47:55 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:47:55 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.238s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:47:55 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Deleted volume successfully. Jul 17 15:47:55 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e26e9828-3a07-431c-9b26-cedf1709ebe8 tempest-ProjectMemberTests-2038443663 None] Lock "cinder-a4b89ed2-a5ee-4ca1-8b6c-334434f174f5-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:05 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=30,cinder:INSERT=12,cinder:UPDATE=50,cinder:DELETE=3 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:48:05 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=46,cinder:UPDATE=50,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Flow 'volume_create_manager' (42f15cf6-6e18-4d1c-8c55-3ac68cb7fe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53219bf2-2061-41d3-b9ac-330724f16a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53219bf2-2061-41d3-b9ac-330724f16a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1850608897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b374e09d-33e6-41f1-b272-7407fb77ab21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28c78600c63441e9af6e83ce2ed0689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:48:23Z,use_quota=True,user_id='d378be48befa401fa3c9104f0ddee092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fccb332-49bc-4c20-89c6-6582d8a26ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fccb332-49bc-4c20-89c6-6582d8a26ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5373519-9466-46ea-a1f8-2133633712d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5373519-9466-46ea-a1f8-2133633712d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b374e09d-33e6-41f1-b272-7407fb77ab21', 'volume_name': 'volume-b374e09d-33e6-41f1-b272-7407fb77ab21', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee880078-f1e2-4685-96e3-cb562e78bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee880078-f1e2-4685-96e3-cb562e78bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e5e169-a98b-4636-9b20-d386b5263d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:22 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Volume b374e09d-33e6-41f1-b272-7407fb77ab21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b374e09d-33e6-41f1-b272-7407fb77ab21', 'volume_size': 1} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1850608897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b374e09d-33e6-41f1-b272-7407fb77ab21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28c78600c63441e9af6e83ce2ed0689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:48:23Z,use_quota=True,user_id='d378be48befa401fa3c9104f0ddee092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)}" {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Creating volume b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:48:22 devstack cinder-volume[87769]: INFO cinder.volume.drivers.remotefs [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 1073741824 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:48:22 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:22 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 1073741824 Jul 17 15:48:22 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:22 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:48:22 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:23 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.245s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo_service.periodic_task [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] Running periodic task VolumeManager._thread_info {{(pid=87769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread count: 28 {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-027dc846-4400-4127-bbf1-6d7608edd001 None None] thread info: [<_MainThread(MainThread, started 139749657878656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 15:48:23 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 1073741824" returned: 0 in 0.426s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:23 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 Jul 17 15:48:23 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:23 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21" returned: 0 in 0.232s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'} {{(pid=87769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e5e169-a98b-4636-9b20-d386b5263d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b374e09d-33e6-41f1-b272-7407fb77ab21', 'volume_size': 1}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c5b052-a519-4f85-b860-ac80deaadd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:23 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Volume volume-b374e09d-33e6-41f1-b272-7407fb77ab21 (b374e09d-33e6-41f1-b272-7407fb77ab21): created successfully Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c5b052-a519-4f85-b860-ac80deaadd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Flow 'volume_create_manager' (42f15cf6-6e18-4d1c-8c55-3ac68cb7fe9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:48:23 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-fe0c1342-9937-4a9f-874f-18b16d6f1f8c tempest-SnapshotDependencyTests-1458143678 None] Created volume successfully. Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Creating offline snapshot a692d26c-712a-4a72-80b9-192ed0129c16 of volume b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[30769959-c0c2-4b8a-8931-b1355cb8763c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:48:23 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:24 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 Jul 17 15:48:24 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:24 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21" returned: 0 in 0.357s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 1G {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:24 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 1G Jul 17 15:48:24 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:24 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 1G" returned: 0 in 0.377s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:24 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b374e09d-33e6-41f1-b272-7407fb77ab21 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:24 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b374e09d-33e6-41f1-b272-7407fb77ab21 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 Jul 17 15:48:24 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:25 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b374e09d-33e6-41f1-b272-7407fb77ab21 -F qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16" returned: 0 in 0.285s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:25 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 is being set with open permissions: ugo+rw Jul 17 15:48:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:25 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 Jul 17 15:48:25 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:25 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16" returned: 0 in 0.240s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:25 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.info Jul 17 15:48:25 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:25 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.info" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:25 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.info is being set with open permissions: ugo+rw Jul 17 15:48:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.info {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:25 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.info Jul 17 15:48:25 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:25 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.info" returned: 0 in 0.243s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:25 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:48:25 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-116cd506-256e-43cf-9ad3-8ea9f36d7695 tempest-SnapshotDependencyTests-1458143678 None] Create snapshot completed successfully Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Flow 'volume_create_manager' (7ee37a19-9095-4695-87b1-f6503be87bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2d4742-ef40-4759-94bf-06b3ac5f5d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2d4742-ef40-4759-94bf-06b3ac5f5d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T13:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba763ed3-0531-4f16-a608-4bd3cefc677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28c78600c63441e9af6e83ce2ed0689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T13:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a692d26c-712a-4a72-80b9-192ed0129c16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T13:48:27Z,use_quota=True,user_id='d378be48befa401fa3c9104f0ddee092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73c9c2b6-955a-4ae7-b954-69386221bc79),volume_type_id=73c9c2b6-955a-4ae7-b954-69386221bc79)' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca517de7-f15d-4bcd-b8c3-27be59a0f165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca517de7-f15d-4bcd-b8c3-27be59a0f165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a846ad9-bbe9-4e49-8523-25ac652c9455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a846ad9-bbe9-4e49-8523-25ac652c9455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ba763ed3-0531-4f16-a608-4bd3cefc677c', 'volume_name': 'volume-ba763ed3-0531-4f16-a608-4bd3cefc677c', 'volume_size': 1, 'snapshot_id': 'a692d26c-712a-4a72-80b9-192ed0129c16'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721d2185-8f44-4fe4-b514-ca61c1d2e219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721d2185-8f44-4fe4-b514-ca61c1d2e219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcd0ab6-ed4b-44bb-9822-a93d56a1b739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:26 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Volume ba763ed3-0531-4f16-a608-4bd3cefc677c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ba763ed3-0531-4f16-a608-4bd3cefc677c', 'volume_size': 1, 'snapshot_id': 'a692d26c-712a-4a72-80b9-192ed0129c16'} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "cinder-quobyte-a692d26c-712a-4a72-80b9-192ed0129c16-ba763ed3-0531-4f16-a608-4bd3cefc677c" by "_create_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-a692d26c-712a-4a72-80b9-192ed0129c16-ba763ed3-0531-4f16-a608-4bd3cefc677c" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Creating volume ba763ed3-0531-4f16-a608-4bd3cefc677c from snapshot a692d26c-712a-4a72-80b9-192ed0129c16 {{(pid=87769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711 as target Quobyte volume. {{(pid=87769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "cinder-quobyte-ba763ed3-0531-4f16-a608-4bd3cefc677c" by "_copy_volume_from_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-ba763ed3-0531-4f16-a608-4bd3cefc677c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] snapshot: a692d26c-712a-4a72-80b9-192ed0129c16, volume: ba763ed3-0531-4f16-a608-4bd3cefc677c, {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b199dd-9b9c-444d-a822-bbef9c54a4cd]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:48:26 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:26 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 Jul 17 15:48:26 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:27 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16" returned: 0 in 0.345s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b374e09d-33e6-41f1-b272-7407fb77ab21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:48:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 15:48:27 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Creating direct copy from snapshot {{(pid=87769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 15:48:27 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba68407-7761-4700-b3b2-4a60a4627e6c]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:48:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:27 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 Jul 17 15:48:27 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:27 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21" returned: 0 in 0.350s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:27 devstack cinder-volume[87769]: DEBUG cinder.utils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Path /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c not found in is_blk_device check {{(pid=87769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 15:48:27 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:27 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c Jul 17 15:48:27 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:31 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c" returned: 0 in 4.004s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:31 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[292bffba-0cd4-4d8a-8952-6643b4674e58]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:48:31 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:31 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 Jul 17 15:48:31 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:32 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21" returned: 0 in 0.540s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG cinder.image.image_utils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Image conversion details: src /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c {{(pid=87769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 15:48:32 devstack cinder-volume[87769]: INFO cinder.image.image_utils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Converted 1024.00 MB image at 255.63 MB/s Jul 17 15:48:32 devstack cinder-volume[87769]: WARNING cinder.volume.drivers.remotefs [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c is being set with open permissions: ugo+rw Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:32 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c Jul 17 15:48:32 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:32 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c" returned: 0 in 0.244s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-ba763ed3-0531-4f16-a608-4bd3cefc677c" released by "_copy_volume_from_snapshot" :: held 5.566s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-a692d26c-712a-4a72-80b9-192ed0129c16-ba763ed3-0531-4f16-a608-4bd3cefc677c" released by "_create_volume_from_snapshot" :: held 5.592s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.606s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcd0ab6-ed4b-44bb-9822-a93d56a1b739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba763ed3-0531-4f16-a608-4bd3cefc677c', 'volume_size': 1, 'snapshot_id': 'a692d26c-712a-4a72-80b9-192ed0129c16'}' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a19ec1b-d9a6-4f0a-b27e-ee02f2ff7423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 15:48:32 devstack cinder-volume[87769]: INFO cinder.volume.flows.manager.create_volume [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Volume volume-ba763ed3-0531-4f16-a608-4bd3cefc677c (ba763ed3-0531-4f16-a608-4bd3cefc677c): created successfully Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a19ec1b-d9a6-4f0a-b27e-ee02f2ff7423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 15:48:32 devstack cinder-volume[87769]: DEBUG cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Flow 'volume_create_manager' (7ee37a19-9095-4695-87b1-f6503be87bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 15:48:32 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-a29ef32a-4c2b-4837-b624-a3cdbe68c27d tempest-SnapshotDependencyTests-1458143678 None] Created volume successfully. Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "cinder-a692d26c-712a-4a72-80b9-192ed0129c16-delete_snapshot" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-a692d26c-712a-4a72-80b9-192ed0129c16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "cinder-quobyte-b374e09d-33e6-41f1-b272-7407fb77ab21" by "delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-b374e09d-33e6-41f1-b272-7407fb77ab21" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "cinder-quobyte-a692d26c-712a-4a72-80b9-192ed0129c16" by "_delete_snapshot" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-a692d26c-712a-4a72-80b9-192ed0129c16" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Deleting offline snapshot a692d26c-712a-4a72-80b9-192ed0129c16 of volume b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] snapshot_file for this snap is: volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 {{(pid=87769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db41bb6-82b5-48c7-bb87-f6298bca4362]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:33 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 Jul 17 15:48:33 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:33 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16" returned: 0 in 0.351s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.remotefs [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b374e09d-33e6-41f1-b272-7407fb77ab21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb06b12-3b73-486e-a6e6-62674f8836ef]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:48:33 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:33 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 Jul 17 15:48:33 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:34 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21" returned: 0 in 0.358s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:34 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 Jul 17 15:48:34 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:34 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16" returned: 0 in 0.333s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:34 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16 Jul 17 15:48:34 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:34 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:34 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21.a692d26c-712a-4a72-80b9-192ed0129c16" returned: 0 in 0.238s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-a692d26c-712a-4a72-80b9-192ed0129c16" released by "_delete_snapshot" :: held 1.375s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-b374e09d-33e6-41f1-b272-7407fb77ab21" released by "delete_snapshot" :: held 1.398s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:34 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Created reservations ['cb394256-0d95-42ef-a310-e2ee03b14d6e', '3f45b5ed-ba61-42a2-8ff1-16e9c47f6727', 'a3b29177-4543-4397-8145-c56b1732eb09', '9e681ae1-56f9-477d-be4f-0998fb0b4321'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:48:34 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Delete snapshot completed successfully. Jul 17 15:48:34 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-1afefdc2-a13c-442d-bb14-2faec072a521 tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-a692d26c-712a-4a72-80b9-192ed0129c16-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "cinder-b374e09d-33e6-41f1-b272-7407fb77ab21-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:48:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-b374e09d-33e6-41f1-b272-7407fb77ab21-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:48:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "cinder-quobyte-b374e09d-33e6-41f1-b272-7407fb77ab21" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:48:35 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-b374e09d-33e6-41f1-b272-7407fb77ab21" acquired by "delete_volume" :: waited 0.014s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:48:35 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8840fa-f3ec-498f-920e-a13fa7fbca86]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:48:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:35 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 Jul 17 15:48:35 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:35 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21" returned: 0 in 0.355s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:35 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:35 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21 Jul 17 15:48:35 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:36 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-b374e09d-33e6-41f1-b272-7407fb77ab21" returned: 0 in 0.246s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-b374e09d-33e6-41f1-b272-7407fb77ab21" released by "delete_volume" :: held 0.658s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Created reservations ['d9916d19-c1e8-4c3e-b03d-678fc84da9e9', '83ece7b6-f0f5-4967-9098-9d3f56266095', 'f6c12f5d-8639-424f-8136-247e47cda9f3', '8dd45741-b273-4c83-846e-90311965841f'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:36 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:48:36 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:36 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.238s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:48:36 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Deleted volume successfully. Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-277a754f-af70-4ec5-83d7-c177ede64ecf tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-b374e09d-33e6-41f1-b272-7407fb77ab21-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "cinder-ba763ed3-0531-4f16-a608-4bd3cefc677c-delete_volume" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-ba763ed3-0531-4f16-a608-4bd3cefc677c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "cinder-quobyte-ba763ed3-0531-4f16-a608-4bd3cefc677c" by "delete_volume" {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-ba763ed3-0531-4f16-a608-4bd3cefc677c" acquired by "delete_volume" :: waited 0.015s {{(pid=87769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af3802d-2183-4e40-924d-e7fd90dc32ce]: (4, 'qcow2') {{(pid=88873) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:36 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c Jul 17 15:48:36 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:36 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c" returned: 0 in 0.342s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:36 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:36 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c Jul 17 15:48:36 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:37 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a/volume-ba763ed3-0531-4f16-a608-4bd3cefc677c" returned: 0 in 0.245s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-quobyte-ba763ed3-0531-4f16-a608-4bd3cefc677c" released by "delete_volume" :: held 0.629s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG cinder.quota [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Created reservations ['d1d1c948-9e50-4d12-8c71-be684a03838d', 'b756825d-f820-4e8a-a218-03bf1f60fe38', 'dd330cd6-3cc8-43ad-8a43-715bda0d84c7', '9034225a-47b7-49de-9256-8c8053641c66'] {{(pid=87769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711': None} {{(pid=87769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG cinder.volume.drivers.quobyte [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c3a430-828d-4e07-9b8c-8fba8cc59711'] {{(pid=87769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.lockutils [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 15:48:37 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a Jul 17 15:48:37 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 15:48:37 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG oslo_concurrency.processutils [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d6d69f564d2c8f91247160f921dd098a" returned: 0 in 0.239s {{(pid=87769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG cinder.manager [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Notifying Schedulers of capabilities ... {{(pid=87769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 15:48:37 devstack cinder-volume[87769]: INFO cinder.volume.manager [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Deleted volume successfully. Jul 17 15:48:37 devstack cinder-volume[87769]: DEBUG cinder.coordination [None req-e7c0754c-928b-42ff-8adb-0dfdf4f0526d tempest-SnapshotDependencyTests-1458143678 None] Lock "cinder-ba763ed3-0531-4f16-a608-4bd3cefc677c-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 15:48:47 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:UPDATE=29,cinder:SELECT=25,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 15:48:47 devstack cinder-volume[87769]: DEBUG dbcounter [-] [87769] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}